Jul 17 14:07:33 devstack cinder-volume[76659]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 14:07:33 devstack cinder-volume[76659]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 14:07:33 devstack cinder-volume[76659]: we strongly recommend against using it for new projects. Jul 17 14:07:33 devstack cinder-volume[76659]: If you are already using Eventlet, we recommend migrating to a different Jul 17 14:07:33 devstack cinder-volume[76659]: framework. For more detail see Jul 17 14:07:33 devstack cinder-volume[76659]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 14:07:33 devstack cinder-volume[76659]: import eventlet # noqa Jul 17 14:07:36 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:07:36 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:07:36 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:07:37 devstack cinder-volume[76659]: INFO dbcounter [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Registered counter for database cinder Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG oslo_db.sqlalchemy.engines [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG dbcounter [-] [76659] Writer thread running {{(pid=76659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:07:37 devstack cinder-volume[76659]: INFO cinder.rpc [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 14:07:37 devstack cinder-volume[76659]: INFO cinder.rpc [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG oslo_db.sqlalchemy.engines [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:07:37 devstack cinder-volume[76659]: INFO cinder.volume.manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Determined volume DB was empty at startup. Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG cinder.volume.manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76659) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 14:07:37 devstack cinder-volume[76659]: INFO cinder.volume.manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 14:07:37 devstack cinder-volume[76659]: WARNING stevedore.named [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 14:07:37 devstack cinder-volume[76659]: WARNING castellan.key_manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:07:37 devstack cinder-volume[76659]: WARNING cinder.keymgr.conf_key_mgr [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG cinder.volume.drivers.lvm [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76659) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 17 14:07:37 devstack cinder-volume[76659]: DEBUG oslo_concurrency.processutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_concurrency.processutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] CMD "cinder-rtstool verify" returned: 0 in 0.434s {{(pid=76659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_db.sqlalchemy.engines [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:07:38 devstack cinder-volume[76659]: INFO cinder.rpc [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 17 14:07:38 devstack cinder-volume[76659]: INFO cinder.rpc [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 17 14:07:38 devstack cinder-volume[76659]: WARNING stevedore.named [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 14:07:38 devstack cinder-volume[76659]: WARNING castellan.key_manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:07:38 devstack cinder-volume[76659]: INFO cinder.volume.manager [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_db.sqlalchemy.engines [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:07:38 devstack cinder-volume[76659]: INFO oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Starting 1 workers Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Started child 76807 {{(pid=76659) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Full set of CONF: {{(pid=76659) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] ******************************************************************************** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Configuration options gathered from: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] ================================================================================ {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 14:07:38 devstack cinder-volume[76807]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] allow_availability_zone_fallback = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] allow_compression_on_image_upload = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] allowed_direct_url_schemes = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] api_rate_limit = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] auth_strategy = keystone {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] az_cache_duration = 3600 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_availability_zone = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_host = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_stats_polling_interval = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backup_api_class = cinder.backup.api.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backup_name_template = backup-%s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backup_use_same_host = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backup_use_temp_snapshot = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] chap_password = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] chap_username = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_internal_tenant_project_id = 6355ea0c84034d59be7266e0999f5053 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_internal_tenant_user_id = aab0500b8a4c491ca5ac4b0c43d36eca {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cloned_volume_same_az = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cluster = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] compression_format = gzip {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] compute_api_class = cinder.compute.nova.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] config_dir = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] config_source = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] control_exchange = openstack {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] debug = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] default_availability_zone = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] default_group_type = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] default_volume_type = lvmdriver-1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] disk_geometry = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_client_cert = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_client_cert_key = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_data_namespace = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_ssl_cert_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_ssl_cert_verify = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] driver_use_ssl = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] enable_force_upload = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] enable_new_services = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] enable_unsupported_driver = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] enabled_backends = ['lvmdriver-1'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] enforce_multipath_for_image_xfer = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] filter_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_api_insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_api_ssl_compression = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_ca_certificates_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_catalog_info = image:glance:publicURL {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_num_retries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance_request_timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] goodness_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] graceful_shutdown_timeout = 5 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] group_api_class = cinder.group.api.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] host = devstack {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_compress_on_upload = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_conversion_address_space_limit = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_conversion_cpu_limit = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_conversion_disable = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_upload_use_cinder_backend = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_upload_use_internal_tenant = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_volume_cache_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_volume_cache_max_count = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] image_volume_cache_max_size_gb = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] init_host_max_objects_retrieval = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] instance_format = [instance: %(uuid)s] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iscsi_target_flags = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iscsi_write_cache = on {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iser_helper = tgtadm {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iser_ip_address = 192.168.122.106 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iser_port = 3260 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_color = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_config_append = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_dir = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_options = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_rotate_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_rotate_interval_type = days {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] log_rotation_type = none {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] max_age = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] max_logfile_count = 30 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] max_logfile_size_mb = 200 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] max_over_subscription_ratio = 20.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] message_reap_interval = 86400 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] message_ttl = 2592000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] migration_create_volume_timeout_secs = 300 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] monkey_patch = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] monkey_patch_modules = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] my_ip = 192.168.122.106 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] no_snapshot_gb_quota = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] num_iser_scan_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] num_shell_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] num_volume_device_scan_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] nvmeof_conn_info_version = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] nvmet_ns_id = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] nvmet_port_id = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_max_limit = 1000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_ext_list = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_listen_port = 8776 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_use_ssl = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] osapi_volume_workers = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] per_volume_size_limit = -1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] periodic_fuzzy_delay = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] periodic_interval = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76807]: INFO cinder.volume.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] public_endpoint = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] publish_errors = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_backup_gigabytes = 1000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_backups = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_gigabytes = 1000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_groups = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_snapshots = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] quota_volumes = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] rate_limit_burst = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] rate_limit_except_level = CRITICAL {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] rate_limit_interval = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] reinit_driver_count = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] replication_device = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] report_discard_supported = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] report_interval = 120 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] reservation_clean_interval = 86400 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] reservation_expire = 86400 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] reserved_image_namespaces = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] reserved_percentage = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] rpc_response_timeout = 120 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] run_external_periodic_tasks = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] scst_target_driver = iscsi {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] scst_target_iqn_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_down_time = 720 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] shell_completion = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] snapshot_name_template = snapshot-%s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] snapshot_same_host = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] split_loggers = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] state_path = /opt/stack/data/cinder {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] storage_availability_zone = nova {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] storage_protocol = iSCSI {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] syslog_log_facility = LOG_USER {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_helper = lioadm {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_ip_address = 192.168.122.106 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_port = 3260 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_protocol = iscsi {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] target_secondary_ip_addresses = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] trace_flags = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] transport_url = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] until_refresh = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_chap_auth = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_default_quota_class = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_journal = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_json = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_multipath_for_image_xfer = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_stderr = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] use_syslog = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] verify_glance_signatures = enabled {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_api_class = cinder.volume.api.API {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_backend_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_clear = zero {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_clear_ionice = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_clear_size = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_copy_bps_limit = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_dd_blocksize = 1M {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_name_template = volume-%s {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_service_inithost_offload = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volume_usage_audit_period = month {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] zoning_mode = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_concurrency.disable_process_locking = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.auth_section = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.auth_type = password {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.auth_version = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.cache = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.include_service_catalog = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.interface = public {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_password = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcache_username = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.region_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.service_token_roles_required = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.service_type = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.backend = dogpile.cache.null {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.backend_argument = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.backend_expiration_time = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.config_prefix = cache.oslo {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.debug_cache_backend = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.enable_retry_client = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.enable_socket_keepalive = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.expiration_time = 600 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.hashclient_retry_attempts = 2 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_dead_retry = 300 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_pool_maxsize = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_sasl_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.password = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.proxies = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.redis_db = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.redis_server = localhost:6379 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.retry_attempts = 2 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.retry_delay = 0.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.socket_keepalive_count = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.socket_keepalive_idle = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.socket_keepalive_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.socket_timeout = 1.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.tls_allowed_ciphers = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.tls_cafile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.tls_certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.tls_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.tls_keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cache.username = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] coordination.backend_url = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.asyncio_connection = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.asyncio_slave_connection = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.backend = sqlalchemy {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.connection = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.connection_debug = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.connection_parameters = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.connection_recycle_time = 3600 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.connection_trace = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.db_inc_retry_interval = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.db_max_retries = 20 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.db_max_retry_interval = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.db_retry_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.max_overflow = 50 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.max_pool_size = 5 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.max_retries = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.mysql_wsrep_sync_wait = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.pool_timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.retry_interval = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.slave_connection = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.sqlite_synchronous = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.synchronous_reader = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] database.use_db_reconnect = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.connection_string = messaging:// {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.es_doc_type = notification {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.es_scroll_size = 10000 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.es_scroll_time = 2m {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.filter_error_trace = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.hmac_keys = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.sentinel_service_name = mymaster {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.socket_timeout = 0.1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.trace_requests = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler.trace_sqlalchemy = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler_jaeger.process_tags = {} {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler_jaeger.service_name_prefix = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] profiler_otlp.service_name_prefix = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.enforce_new_defaults = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.policy_default_rule = default {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.policy_file = policy.yaml {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.group = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.helper_command = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:38 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] privsep_osbrick.user = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.group = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.helper_command = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] cinder_sys_admin.user = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.auth_section = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.auth_type = password {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.cafile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.collect_timing = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.send_service_user_token = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.split_loggers = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] service_user.timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.auth_section = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.auth_type = password {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.collect_timing = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.region_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.split_loggers = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] glance.timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.backend_availability_zone = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.chap_password = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.chap_username = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.disk_geometry = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_client_cert = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_client_cert_key = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_data_namespace = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.driver_use_ssl = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.extra_capabilities = {} {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.filter_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.goodness_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iscsi_target_flags = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iscsi_write_cache = on {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iser_helper = tgtadm {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iser_port = 3260 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.lvm_mirrors = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.lvm_share_target = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.lvm_type = auto {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.num_shell_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.replication_device = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.report_discard_supported = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.reserved_percentage = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_helper = tgtadm {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_port = 3260 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_protocol = iscsi {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.trace_flags = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.unique_fqdn_network = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.use_chap_auth = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_backend_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_clear = zero {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_clear_ionice = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_clear_size = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volume_group = cinder-volumes {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_reports.file_event_handler = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_reports.log_dir = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.backend_availability_zone = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.backend_host = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.chap_password = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.chap_username = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.chiscsi_conf = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.disk_geometry = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_client_cert = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_data_namespace = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.driver_use_ssl = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.extra_capabilities = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.filter_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.goodness_function = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iser_helper = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iser_ip_address = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iser_port = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.iser_target_prefix = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.lvm_conf_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.lvm_mirrors = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.lvm_share_target = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.lvm_type = auto {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.num_shell_tries = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.nvmet_port_id = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.replication_device = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.report_discard_supported = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.reserved_percentage = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.scst_target_driver = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.storage_protocol = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_helper = lioadm {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_ip_address = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_port = 3260 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_protocol = iscsi {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.trace_flags = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.use_chap_auth = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_clear = zero {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_clear_size = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] lvmdriver-1.volumes_dir = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_notifications.driver = [] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_notifications.retry = -1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] key_manager.fixed_key = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.barbican_api_version = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.barbican_endpoint = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.barbican_endpoint_type = public {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.barbican_region_name = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.cafile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.collect_timing = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.number_of_retries = 60 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.retry_delay = 1 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.send_service_user_token = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.split_loggers = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.verify_ssl = True {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican.verify_ssl_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.auth_section = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.auth_type = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.cafile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.certfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.collect_timing = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.insecure = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.keyfile = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.split_loggers = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] barbican_service_user.timeout = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.approle_role_id = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.approle_secret_id = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.auth_method = approle {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.auth_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.kv_mountpoint = secret {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.kv_path = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.kv_version = 2 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.namespace = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.root_token_id = **** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.ssl_ca_crt_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.timeout = 60.0 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.token_file = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.token_role = None {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.use_ssl = False {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:07:38 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] ******************************************************************************** {{(pid=76659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 14:07:39 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:39 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:39 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:39 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.340s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:07:39 devstack cinder-volume[76807]: INFO cinder.brick.local_dev.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:39 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:39 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:39 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG cinder.brick.local_dev.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76807) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 17 14:07:39 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:39 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:39 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:40 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:40 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:40 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:40 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.349s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:40 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:40 devstack sudo[77381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 17 14:07:40 devstack sudo[77381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:41 devstack sudo[77381]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.365s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:41 devstack sudo[77459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:41 devstack sudo[77459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:41 devstack sudo[77459]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.409s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:41 devstack sudo[77542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:41 devstack sudo[77542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:41 devstack sudo[77542]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:41 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:42 devstack sudo[77549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:42 devstack sudo[77549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:42 devstack sudo[77549]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:42 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:42 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:42 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:42 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:42 devstack sudo[77639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:42 devstack sudo[77639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:42 devstack sudo[77639]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:43 devstack cinder-volume[76807]: INFO cinder.volume.drivers.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:43 devstack sudo[77643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:43 devstack sudo[77643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:43 devstack sudo[77643]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:43 devstack sudo[77646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:43 devstack sudo[77646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:43 devstack sudo[77646]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:43 devstack sudo[77649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:43 devstack sudo[77649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:43 devstack sudo[77649]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:43 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:43 devstack sudo[77658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:43 devstack sudo[77658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:44 devstack sudo[77658]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:44 devstack sudo[77661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:44 devstack sudo[77661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:44 devstack sudo[77661]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:44 devstack cinder-volume[76807]: INFO cinder.volume.driver [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Driver hasn't implemented _init_vendor_properties() Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG cinder.volume.driver [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76807) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_db.sqlalchemy.engines [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76807) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writer thread running {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG cinder.db.api [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Building query based on filter {{(pid=76807) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG cinder.image.image_utils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76807) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 14:07:44 devstack cinder-volume[76807]: INFO cinder.keymgr.migration [None req-c7a2ef67-d960-4b57-8356-7c8d640c3322 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:44 devstack sudo[77665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:44 devstack sudo[77665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:44 devstack sudo[77665]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:44 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:44 devstack sudo[77671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:44 devstack sudo[77671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:45 devstack sudo[77671]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:45 devstack sudo[77674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:45 devstack sudo[77674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:45 devstack sudo[77674]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:45 devstack sudo[77677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:45 devstack sudo[77677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:45 devstack sudo[77677]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG cinder.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Notifying Schedulers of capabilities ... {{(pid=76807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:07:45 devstack cinder-volume[76807]: INFO cinder.volume.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Driver initialization completed successfully. Jul 17 14:07:45 devstack cinder-volume[76807]: INFO cinder.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Initiating service 2 cleanup Jul 17 14:07:45 devstack cinder-volume[76807]: INFO cinder.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Service 2 cleanup completed. Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG cinder.service [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Creating RPC server for service cinder-volume {{(pid=76807) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG cinder.service [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76807) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 14:07:45 devstack cinder-volume[76807]: INFO cinder.volume.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:07:45 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:45 devstack sudo[77683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:07:45 devstack sudo[77683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:46 devstack sudo[77683]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:46 devstack sudo[77686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:46 devstack sudo[77686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:46 devstack sudo[77686]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:46 devstack sudo[77689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:07:46 devstack sudo[77689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:46 devstack sudo[77689]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:46 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:07:46 devstack sudo[77692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:07:46 devstack sudo[77692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:07:47 devstack sudo[77692]: pam_unix(sudo:session): session closed for user root Jul 17 14:07:47 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:07:47 devstack cinder-volume[76807]: INFO cinder.volume.manager [None req-8bbfc136-2e10-4c3e-93ef-a79113a80d7c None None] Driver post RPC initialization completed successfully. Jul 17 14:07:48 devstack cinder-volume[76659]: DEBUG dbcounter [-] [76659] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:07:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:SELECT=3 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:07:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:08:33 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:08:33 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread count: 6 {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:08:33 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread info: [<_MainThread(MainThread, started 136670621372544)>, , , , , ] {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:09:33 devstack sudo[82516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:09:33 devstack sudo[82516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:09:33 devstack sudo[82516]: pam_unix(sudo:session): session closed for user root Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:09:33 devstack sudo[82680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:09:33 devstack sudo[82680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:09:33 devstack sudo[82680]: pam_unix(sudo:session): session closed for user root Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:09:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:09:33 devstack sudo[82801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:09:33 devstack sudo[82801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:09:34 devstack sudo[82801]: pam_unix(sudo:session): session closed for user root Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:09:34 devstack sudo[82833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:09:34 devstack sudo[82833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:09:34 devstack sudo[82833]: pam_unix(sudo:session): session closed for user root Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG cinder.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Notifying Schedulers of capabilities ... {{(pid=76807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread count: 6 {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:09:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread info: [<_MainThread(MainThread, started 136670621372544)>, , , , , ] {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:09:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:SELECT=1 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:09:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:UPDATE=1 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:10:33 devstack sudo[83972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:10:33 devstack sudo[83972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:10:33 devstack sudo[83972]: pam_unix(sudo:session): session closed for user root Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:10:33 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:10:33 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:10:33 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:10:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:10:33 devstack sudo[83985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:10:33 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:10:34 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:10:34 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:10:34 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:10:34 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG cinder.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Notifying Schedulers of capabilities ... {{(pid=76807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread count: 6 {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:10:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread info: [<_MainThread(MainThread, started 136670621372544)>, , , , , ] {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:11:33 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:11:33 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:11:33 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:11:33 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:11:33 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:11:33 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:11:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:11:33 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:11:33 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:11:34 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:11:34 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:11:34 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:11:34 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG cinder.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Notifying Schedulers of capabilities ... {{(pid=76807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread count: 6 {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:11:34 devstack cinder-volume[76807]: DEBUG cinder.volume.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] thread info: [<_MainThread(MainThread, started 136670621372544)>, , , , , ] {{(pid=76807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:11:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:SELECT=1 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:11:57 devstack cinder-volume[76807]: DEBUG dbcounter [-] [76807] Writing DB stats cinder:UPDATE=1 {{(pid=76807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_service.periodic_task [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG cinder.volume.drivers.lvm [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Updating volume stats {{(pid=76807) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:33 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 14:12:33 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:33 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:33 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:12:33 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:33 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:33 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:33 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 14:12:33 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:34 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:34 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 14:12:34 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:34 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:34 devstack cinder-volume[76807]: DEBUG oslo_concurrency.processutils [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:34 devstack cinder-volume[76807]: DEBUG cinder.manager [None req-882a2af2-6568-480a-aeab-4940299669d9 None None] Notifying Schedulers of capabilities ... {{(pid=76807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:12:45 devstack cinder-volume[76659]: INFO oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Caught SIGTERM, stopping children Jul 17 14:12:45 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Acquiring lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:12:45 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Acquired lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:12:45 devstack cinder-volume[76659]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Releasing lock "singleton_lock" {{(pid=76659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:12:45 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Stop services. {{(pid=76659) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 14:12:45 devstack cinder-volume[76659]: DEBUG oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Killing children. {{(pid=76659) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 14:12:45 devstack cinder-volume[76659]: INFO oslo_service.backend._eventlet.service [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Waiting on 1 children to exit Jul 17 14:12:50 devstack cinder-volume[76807]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 17 14:12:50 devstack cinder-volume[86983]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 14:12:50 devstack cinder-volume[86983]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 14:12:50 devstack cinder-volume[86983]: we strongly recommend against using it for new projects. Jul 17 14:12:50 devstack cinder-volume[86983]: If you are already using Eventlet, we recommend migrating to a different Jul 17 14:12:50 devstack cinder-volume[86983]: framework. For more detail see Jul 17 14:12:50 devstack cinder-volume[86983]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 14:12:50 devstack cinder-volume[86983]: import eventlet # noqa Jul 17 14:12:50 devstack cinder-volume[76807]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Acquiring lock "singleton_lock" {{(pid=76807) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:12:50 devstack cinder-volume[76807]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Acquired lock "singleton_lock" {{(pid=76807) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:12:50 devstack cinder-volume[76807]: DEBUG oslo_concurrency.lockutils [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Releasing lock "singleton_lock" {{(pid=76807) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:12:50 devstack cinder-volume[76807]: WARNING amqp [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 14:12:50 devstack cinder-volume[76807]: WARNING amqp [None req-ce54c162-c1b1-4f9c-b0af-28d292f228cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 14:12:52 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:12:52 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:12:52 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:12:53 devstack cinder-volume[86983]: INFO dbcounter [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Registered counter for database cinder Jul 17 14:12:53 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:12:53 devstack cinder-volume[86983]: DEBUG dbcounter [-] [86983] Writer thread running {{(pid=86983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:12:53 devstack cinder-volume[86983]: INFO cinder.rpc [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 14:12:53 devstack cinder-volume[86983]: INFO cinder.rpc [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:12:54 devstack cinder-volume[86983]: INFO cinder.volume.manager [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Determined volume DB was empty at startup. Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG cinder.volume.manager [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86983) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 14:12:54 devstack cinder-volume[86983]: INFO cinder.volume.manager [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 14:12:54 devstack cinder-volume[86983]: WARNING stevedore.named [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 14:12:54 devstack cinder-volume[86983]: WARNING castellan.key_manager [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:12:54 devstack cinder-volume[86983]: WARNING cinder.keymgr.conf_key_mgr [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:12:54 devstack cinder-volume[86983]: INFO cinder.volume.manager [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:12:54 devstack cinder-volume[86983]: INFO oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Starting 1 workers Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Started child 87198 {{(pid=86983) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Full set of CONF: {{(pid=86983) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] ******************************************************************************** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Configuration options gathered from: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] ================================================================================ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] allow_availability_zone_fallback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] allow_compression_on_image_upload = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] allowed_direct_url_schemes = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] api_rate_limit = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] auth_strategy = keystone {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_stats_polling_interval = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backup_api_class = cinder.backup.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backup_name_template = backup-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backup_use_same_host = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backup_use_temp_snapshot = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] chap_username = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_internal_tenant_project_id = 6355ea0c84034d59be7266e0999f5053 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_internal_tenant_user_id = aab0500b8a4c491ca5ac4b0c43d36eca {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[87198]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cluster = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] compression_format = gzip {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] config_dir = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] config_source = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] control_exchange = openstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] debug = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] default_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] default_group_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] default_volume_type = QuobyteHD {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_ssl_cert_verify = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] driver_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] enable_new_services = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] enable_unsupported_driver = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] enforce_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_api_insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_api_ssl_compression = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_ca_certificates_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_num_retries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance_request_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] graceful_shutdown_timeout = 5 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] group_api_class = cinder.group.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] host = devstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_compress_on_upload = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_conversion_address_space_limit = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_conversion_cpu_limit = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_conversion_disable = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_upload_use_cinder_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_upload_use_internal_tenant = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_volume_cache_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_volume_cache_max_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] init_host_max_objects_retrieval = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] instance_format = [instance: %(uuid)s] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iscsi_target_flags = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iscsi_write_cache = on {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iser_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iser_ip_address = 192.168.122.106 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iser_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_color = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_config_append = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_options = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_rotate_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_rotate_interval_type = days {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] log_rotation_type = none {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] max_age = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] max_logfile_count = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] max_logfile_size_mb = 200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] max_over_subscription_ratio = 20.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] message_reap_interval = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] message_ttl = 2592000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] monkey_patch = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] monkey_patch_modules = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] my_ip = 192.168.122.106 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] no_snapshot_gb_quota = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] num_iser_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] num_shell_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] num_volume_device_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] nvmeof_conn_info_version = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] nvmet_ns_id = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] nvmet_port_id = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_max_limit = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_ext_list = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_listen_port = 8776 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] osapi_volume_workers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] per_volume_size_limit = -1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] periodic_fuzzy_delay = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] periodic_interval = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] public_endpoint = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] publish_errors = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_backup_gigabytes = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_backups = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_gigabytes = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_groups = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_snapshots = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] quota_volumes = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] rate_limit_burst = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] rate_limit_except_level = CRITICAL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] rate_limit_interval = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] reinit_driver_count = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] report_discard_supported = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] report_interval = 120 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] reservation_clean_interval = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] reservation_expire = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] reserved_image_namespaces = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] reserved_percentage = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] rpc_response_timeout = 120 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] run_external_periodic_tasks = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] scst_target_driver = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_down_time = 720 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] shell_completion = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] snapshot_name_template = snapshot-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] state_path = /opt/stack/data/cinder {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] storage_availability_zone = nova {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] storage_protocol = iSCSI {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] syslog_log_facility = LOG_USER {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_helper = lioadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_ip_address = 192.168.122.106 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_protocol = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] target_secondary_ip_addresses = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] transport_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] until_refresh = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[87198]: INFO cinder.volume.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Starting volume driver QuobyteDriver (1.2) Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_chap_auth = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.remotefs [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87198) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_default_quota_class = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_journal = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_json = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_stderr = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] use_syslog = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] verify_glance_signatures = enabled {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_api_class = cinder.volume.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_clear = zero {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_clear_size = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_copy_bps_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_dd_blocksize = 1M {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_name_template = volume-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_service_inithost_offload = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volume_usage_audit_period = month {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] zoning_mode = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.auth_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.interface = public {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_password = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcache_username = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.service_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.backend = dogpile.cache.null {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.backend_argument = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.backend_expiration_time = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.config_prefix = cache.oslo {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.debug_cache_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.enable_retry_client = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.enable_socket_keepalive = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.expiration_time = 600 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_dead_retry = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_sasl_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.proxies = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.redis_db = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.redis_server = localhost:6379 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.retry_attempts = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.retry_delay = 0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.socket_keepalive_count = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.socket_keepalive_idle = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.socket_keepalive_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.socket_timeout = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.tls_allowed_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.tls_cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.tls_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.tls_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.tls_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cache.username = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] coordination.backend_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.asyncio_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.asyncio_slave_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.backend = sqlalchemy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.connection_debug = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.connection_parameters = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.connection_recycle_time = 3600 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.connection_trace = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.db_inc_retry_interval = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.db_max_retries = 20 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.db_max_retry_interval = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.db_retry_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.max_overflow = 50 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.max_pool_size = 5 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.max_retries = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.pool_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.retry_interval = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.slave_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.sqlite_synchronous = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.synchronous_reader = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] database.use_db_reconnect = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.connection_string = messaging:// {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.es_doc_type = notification {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.es_scroll_size = 10000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.es_scroll_time = 2m {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.filter_error_trace = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.hmac_keys = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.sentinel_service_name = mymaster {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.socket_timeout = 0.1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.trace_requests = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler.trace_sqlalchemy = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler_jaeger.process_tags = {} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] profiler_otlp.service_name_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.policy_default_rule = default {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.group = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.helper_command = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] privsep_osbrick.user = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.group = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.helper_command = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] cinder_sys_admin.user = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.send_service_user_token = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87198) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 14:12:54 devstack cinder-volume[87198]: WARNING cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] service_user.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: WARNING cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] glance.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Running cmd (subprocess): mount.quobyte {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.chap_username = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.driver_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.extra_capabilities = {} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iscsi_target_flags = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iser_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_host = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_login = admin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_mount_options = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_private_key = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_share_path = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.report_discard_supported = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_protocol = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.use_chap_auth = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_clear = zero {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_reports.file_event_handler = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_reports.log_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.backend_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.chap_username = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.extra_capabilities = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iser_helper = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iser_ip_address = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iser_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_login = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_mount_options = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_private_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_share_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.num_shell_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.report_discard_supported = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.reserved_percentage = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.scst_target_driver = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.storage_protocol = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_helper = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_ip_address = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_protocol = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.use_chap_auth = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_clear = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_clear_size = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] QuobyteHD.volumes_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack quobyte-client[87199]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 14:12:54 devstack quobyte-client[87199]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87198) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: INFO cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 ... Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 -c /etc/quobyte/client-cinder.cfg {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_notifications.driver = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] key_manager.fixed_key = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.barbican_api_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.barbican_endpoint = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.barbican_endpoint_type = public {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.barbican_region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.number_of_retries = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.retry_delay = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.send_service_user_token = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.verify_ssl = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican.verify_ssl_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.auth_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 -c /etc/quobyte/client-cinder.cfg Jul 17 14:12:54 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] barbican_service_user.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.approle_role_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.approle_secret_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.auth_method = approle {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.auth_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.kv_mountpoint = secret {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.kv_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.kv_version = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.root_token_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.ssl_ca_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.token_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.token_role = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:12:54 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] ******************************************************************************** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 14:12:54 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.380s {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:54 devstack cinder-volume[87198]: INFO cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 succeeded Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87198) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.393s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:12:54 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:55 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:12:55 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:55 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.251s {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.volume.driver [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Driver hasn't implemented _init_vendor_properties() Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.volume.driver [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6747207641602, 'free_capacity_gb': 1775.6747207641602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87198) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_db.sqlalchemy.engines [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87198) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG dbcounter [-] [87198] Writer thread running {{(pid=87198) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.db.api [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Building query based on filter {{(pid=87198) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.image.image_utils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87198) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.keymgr.migration [None req-2daa9c7d-9b96-473a-b622-1c223ba8d9af None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87198) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87198) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:55 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:12:55 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:55 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.238s {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Notifying Schedulers of capabilities ... {{(pid=87198) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.volume.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Driver initialization completed successfully. Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Initiating service 3 cleanup Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Service 3 cleanup completed. Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.service [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Creating RPC server for service cinder-volume {{(pid=87198) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.service [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87198) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 14:12:55 devstack cinder-volume[87198]: INFO cinder.volume.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87198) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG cinder.volume.drivers.quobyte [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87198) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87198) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:12:55 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:12:55 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:12:55 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:12:56 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Jul 17 14:12:56 devstack cinder-volume[87198]: DEBUG oslo_concurrency.processutils [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.249s {{(pid=87198) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:12:56 devstack cinder-volume[87198]: INFO cinder.volume.manager [None req-0c39c6f5-3ffa-45ce-984a-2e09afd5646b None None] Driver post RPC initialization completed successfully. Jul 17 14:13:00 devstack cinder-volume[86983]: INFO oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Caught SIGTERM, stopping children Jul 17 14:13:00 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Acquiring lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:13:00 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Acquired lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:13:00 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Releasing lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:13:00 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Stop services. {{(pid=86983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 14:13:00 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Killing children. {{(pid=86983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 14:13:00 devstack cinder-volume[86983]: INFO oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Waiting on 1 children to exit Jul 17 14:13:04 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Acquiring lock "singleton_lock" {{(pid=87198) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:13:04 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Acquired lock "singleton_lock" {{(pid=87198) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:13:04 devstack cinder-volume[87198]: DEBUG oslo_concurrency.lockutils [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Releasing lock "singleton_lock" {{(pid=87198) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:13:04 devstack cinder-volume[87198]: WARNING amqp [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 14:13:04 devstack cinder-volume[87198]: WARNING amqp [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 14:13:04 devstack cinder-volume[86983]: INFO oslo_service.backend._eventlet.service [None req-55b66964-a4f2-4a90-922f-fea75609f8c8 None None] Child 87198 exited with status 0 Jul 17 14:13:05 devstack cinder-volume[87487]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 14:13:05 devstack cinder-volume[87487]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 14:13:05 devstack cinder-volume[87487]: we strongly recommend against using it for new projects. Jul 17 14:13:05 devstack cinder-volume[87487]: If you are already using Eventlet, we recommend migrating to a different Jul 17 14:13:05 devstack cinder-volume[87487]: framework. For more detail see Jul 17 14:13:05 devstack cinder-volume[87487]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 14:13:05 devstack cinder-volume[87487]: import eventlet # noqa Jul 17 14:13:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 14:13:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 14:13:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 14:13:08 devstack cinder-volume[87487]: INFO dbcounter [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Registered counter for database cinder Jul 17 14:13:08 devstack cinder-volume[87487]: DEBUG oslo_db.sqlalchemy.engines [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writer thread running {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:13:09 devstack cinder-volume[87487]: INFO cinder.rpc [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 14:13:09 devstack cinder-volume[87487]: INFO cinder.rpc [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_db.sqlalchemy.engines [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:13:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Determined volume DB was empty at startup. Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87487) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 14:13:09 devstack cinder-volume[87487]: WARNING stevedore.named [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 14:13:09 devstack cinder-volume[87487]: WARNING castellan.key_manager [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:13:09 devstack cinder-volume[87487]: WARNING cinder.keymgr.conf_key_mgr [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 14:13:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_db.sqlalchemy.engines [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:13:09 devstack cinder-volume[87487]: INFO oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Starting 1 workers Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Started child 87804 {{(pid=87487) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Full set of CONF: {{(pid=87487) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] ******************************************************************************** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] Configuration options gathered from: {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] ================================================================================ {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] allow_availability_zone_fallback = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] allow_compression_on_image_upload = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] allowed_direct_url_schemes = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] api_rate_limit = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] auth_strategy = keystone {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_availability_zone = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_host = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_stats_polling_interval = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backup_api_class = cinder.backup.api.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backup_name_template = backup-%s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backup_use_same_host = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backup_use_temp_snapshot = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] chap_password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] chap_username = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87804]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_internal_tenant_project_id = 6355ea0c84034d59be7266e0999f5053 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_internal_tenant_user_id = aab0500b8a4c491ca5ac4b0c43d36eca {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cluster = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] compression_format = gzip {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] compute_api_class = cinder.compute.nova.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] config_dir = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] config_source = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] control_exchange = openstack {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] debug = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] default_availability_zone = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] default_group_type = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] default_volume_type = QuobyteHD {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] disk_geometry = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_client_cert = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_client_cert_key = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_data_namespace = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_ssl_cert_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_ssl_cert_verify = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] driver_use_ssl = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] enable_new_services = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] enable_unsupported_driver = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] enabled_backends = ['QuobyteHD'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] enforce_multipath_for_image_xfer = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] filter_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_api_insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_api_ssl_compression = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_ca_certificates_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_catalog_info = image:glance:publicURL {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_num_retries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance_request_timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] goodness_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] graceful_shutdown_timeout = 5 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] group_api_class = cinder.group.api.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] host = devstack {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_compress_on_upload = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_conversion_address_space_limit = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_conversion_cpu_limit = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_conversion_disable = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_upload_use_cinder_backend = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_upload_use_internal_tenant = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_volume_cache_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_volume_cache_max_count = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] image_volume_cache_max_size_gb = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] init_host_max_objects_retrieval = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] instance_format = [instance: %(uuid)s] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iscsi_target_flags = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iscsi_write_cache = on {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iser_helper = tgtadm {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iser_ip_address = 192.168.122.106 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iser_port = 3260 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_color = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_config_append = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_dir = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_options = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_rotate_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_rotate_interval_type = days {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] log_rotation_type = none {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] max_age = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] max_logfile_count = 30 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] max_logfile_size_mb = 200 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] max_over_subscription_ratio = 20.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] message_reap_interval = 86400 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] message_ttl = 2592000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] migration_create_volume_timeout_secs = 300 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] monkey_patch = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] monkey_patch_modules = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] my_ip = 192.168.122.106 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] no_snapshot_gb_quota = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] num_iser_scan_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] num_shell_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] num_volume_device_scan_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] nvmeof_conn_info_version = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] nvmet_ns_id = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] nvmet_port_id = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_max_limit = 1000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_ext_list = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_listen_port = 8776 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_use_ssl = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] osapi_volume_workers = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] per_volume_size_limit = -1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] periodic_fuzzy_delay = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] periodic_interval = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] public_endpoint = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] publish_errors = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_backup_gigabytes = 1000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_backups = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_gigabytes = 1000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_groups = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_snapshots = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] quota_volumes = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] rate_limit_burst = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] rate_limit_except_level = CRITICAL {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] rate_limit_interval = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] reinit_driver_count = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] replication_device = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] report_discard_supported = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] report_interval = 120 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] reservation_clean_interval = 86400 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] reservation_expire = 86400 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] reserved_image_namespaces = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] reserved_percentage = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] rpc_response_timeout = 120 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] run_external_periodic_tasks = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] scst_target_driver = iscsi {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] scst_target_iqn_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_down_time = 720 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] shell_completion = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] snapshot_name_template = snapshot-%s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] split_loggers = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] state_path = /opt/stack/data/cinder {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] storage_availability_zone = nova {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] storage_protocol = iSCSI {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] syslog_log_facility = LOG_USER {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_helper = lioadm {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_ip_address = 192.168.122.106 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_port = 3260 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_protocol = iscsi {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] target_secondary_ip_addresses = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] trace_flags = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] transport_url = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] until_refresh = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_chap_auth = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_default_quota_class = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_journal = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_json = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_multipath_for_image_xfer = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_stderr = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] use_syslog = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] verify_glance_signatures = enabled {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_api_class = cinder.volume.api.API {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_backend_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_clear = zero {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_clear_ionice = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_clear_size = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_copy_bps_limit = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_dd_blocksize = 1M {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_name_template = volume-%s {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_service_inithost_offload = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volume_usage_audit_period = month {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] zoning_mode = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_concurrency.disable_process_locking = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Starting volume driver QuobyteDriver (1.2) Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87804) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.auth_section = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.auth_type = password {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.auth_version = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.cache = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.include_service_catalog = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.interface = public {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_password = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcache_username = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.region_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.service_type = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.backend = dogpile.cache.null {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.backend_argument = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.backend_expiration_time = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.config_prefix = cache.oslo {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.debug_cache_backend = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.enable_retry_client = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.enable_socket_keepalive = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.expiration_time = 600 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.hashclient_retry_attempts = 2 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_dead_retry = 300 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_pool_maxsize = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_sasl_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.proxies = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.redis_db = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.redis_server = localhost:6379 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.retry_attempts = 2 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.retry_delay = 0.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.socket_keepalive_count = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.socket_keepalive_idle = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.socket_keepalive_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.socket_timeout = 1.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.tls_allowed_ciphers = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.tls_cafile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.tls_certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.tls_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.tls_keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cache.username = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] coordination.backend_url = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.asyncio_connection = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.asyncio_slave_connection = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.backend = sqlalchemy {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.connection = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.connection_debug = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.connection_parameters = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.connection_recycle_time = 3600 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.connection_trace = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.db_inc_retry_interval = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.db_max_retries = 20 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.db_max_retry_interval = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.db_retry_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.max_overflow = 50 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.max_pool_size = 5 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.max_retries = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.mysql_wsrep_sync_wait = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.pool_timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.retry_interval = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.slave_connection = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.sqlite_synchronous = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.synchronous_reader = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] database.use_db_reconnect = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.connection_string = messaging:// {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.es_doc_type = notification {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.es_scroll_size = 10000 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.es_scroll_time = 2m {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.filter_error_trace = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.hmac_keys = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.sentinel_service_name = mymaster {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.socket_timeout = 0.1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.trace_requests = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler.trace_sqlalchemy = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler_jaeger.process_tags = {} {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler_jaeger.service_name_prefix = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] profiler_otlp.service_name_prefix = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.enforce_new_defaults = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.policy_default_rule = default {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.policy_file = policy.yaml {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.group = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.helper_command = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] privsep_osbrick.user = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.group = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.helper_command = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] cinder_sys_admin.user = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.auth_section = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.auth_type = password {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.cafile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.collect_timing = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.send_service_user_token = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.split_loggers = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] service_user.timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.auth_section = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.auth_type = password {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.collect_timing = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.region_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.split_loggers = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] glance.timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.backend_availability_zone = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.chap_password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.chap_username = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.disk_geometry = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_client_cert = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_client_cert_key = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_data_namespace = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.driver_use_ssl = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.extra_capabilities = {} {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.filter_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.goodness_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iscsi_target_flags = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iscsi_write_cache = on {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iser_helper = tgtadm {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iser_port = 3260 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_host = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_login = admin {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_mount_options = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_private_key = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_share_path = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.num_shell_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.quobyte_volume_url = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.replication_device = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.report_discard_supported = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.reserved_percentage = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_helper = tgtadm {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_port = 3260 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_protocol = iscsi {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87804) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 14:13:09 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 14:13:09 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.trace_flags = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.unique_fqdn_network = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.use_chap_auth = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_backend_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_clear = zero {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_clear_ionice = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_clear_size = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_reports.file_event_handler = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_reports.log_dir = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.backend_availability_zone = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.backend_host = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.chap_password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.chap_username = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.chiscsi_conf = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.disk_geometry = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_client_cert = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_data_namespace = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Running cmd (subprocess): mount.quobyte {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.driver_use_ssl = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.extra_capabilities = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.filter_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.goodness_function = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iser_helper = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iser_ip_address = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iser_port = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.iser_target_prefix = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_host = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_login = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_mount_options = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_password = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_private_key = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_share_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_ssh_port = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.num_shell_tries = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.nvmet_port_id = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.replication_device = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.report_discard_supported = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.reserved_percentage = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.scst_target_driver = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.storage_protocol = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_helper = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_ip_address = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_port = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_prefix = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_protocol = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.trace_flags = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.use_chap_auth = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_clear = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_clear_size = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] QuobyteHD.volumes_dir = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_notifications.driver = [] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_notifications.retry = -1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] key_manager.fixed_key = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.barbican_api_version = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.barbican_endpoint = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.barbican_endpoint_type = public {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.barbican_region_name = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.cafile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.collect_timing = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.number_of_retries = 60 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.retry_delay = 1 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.send_service_user_token = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.split_loggers = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.verify_ssl = True {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican.verify_ssl_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.auth_section = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.auth_type = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.cafile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.certfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.collect_timing = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.insecure = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.keyfile = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.split_loggers = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] barbican_service_user.timeout = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.approle_role_id = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.approle_secret_id = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.auth_method = approle {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.auth_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.kv_mountpoint = secret {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.kv_path = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.kv_version = 2 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.namespace = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.root_token_id = **** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.ssl_ca_crt_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.timeout = 60.0 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.token_file = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.token_role = None {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.use_ssl = False {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 14:13:09 devstack cinder-volume[87487]: DEBUG oslo_service.backend._eventlet.service [None req-cdea1c1d-ed3f-45d8-a3c9-94e101c44e2f None None] ******************************************************************************** {{(pid=87487) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 14:13:09 devstack quobyte-client[87805]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 14:13:09 devstack quobyte-client[87805]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:13:09 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:13:09 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:13:09 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.236s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:13:09 devstack cinder-volume[87804]: INFO cinder.volume.driver [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.driver [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6747207641602, 'free_capacity_gb': 1775.6747207641602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87804) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_db.sqlalchemy.engines [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writer thread running {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.db.api [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Building query based on filter {{(pid=87804) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87804) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:13:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:13:09 devstack cinder-volume[87804]: INFO cinder.keymgr.migration [None req-ac21887a-54d4-474a-b2a4-f25d19bd6047 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 14:13:09 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:13:09 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:13:10 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.239s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:13:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Driver initialization completed successfully. Jul 17 14:13:10 devstack cinder-volume[87804]: INFO cinder.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Initiating service 3 cleanup Jul 17 14:13:10 devstack cinder-volume[87804]: INFO cinder.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Service 3 cleanup completed. Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG cinder.service [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Creating RPC server for service cinder-volume {{(pid=87804) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG cinder.service [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87804) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 14:13:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:13:10 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:13:10 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:13:10 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Jul 17 14:13:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:13:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0918c814-75ec-457c-b72c-eae794316e84 None None] Driver post RPC initialization completed successfully. Jul 17 14:13:19 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:13:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=3 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:13:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:13:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:13:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 6 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:13:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Flow 'volume_create_manager' (d33bac84-23a1-4c1b-a368-c303d2a61dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652fcbc-0063-446c-8fee-00e388739b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652fcbc-0063-446c-8fee-00e388739b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1798152628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75a530-5a64-4a2a-ba7d-f1cc8446e186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb059d14d9a458a8ce7e7f52df75c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:08Z,use_quota=True,user_id='dab0a3ebfbd24913972d326a9d0fd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ff2b11-d757-48d1-b220-b04a88b8f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ff2b11-d757-48d1-b220-b04a88b8f304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3fb46-ba81-4617-9380-80a1779aeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3fb46-ba81-4617-9380-80a1779aeb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d75a530-5a64-4a2a-ba7d-f1cc8446e186', 'volume_name': 'volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269c441f-cc65-4e8e-8e46-00915875e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269c441f-cc65-4e8e-8e46-00915875e5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752f62b3-678d-4e92-8306-557367cd2933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Volume 2d75a530-5a64-4a2a-ba7d-f1cc8446e186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186', 'volume_size': 1} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1798152628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75a530-5a64-4a2a-ba7d-f1cc8446e186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb059d14d9a458a8ce7e7f52df75c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:08Z,use_quota=True,user_id='dab0a3ebfbd24913972d326a9d0fd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Creating volume 2d75a530-5a64-4a2a-ba7d-f1cc8446e186 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:14:08 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:14:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:08 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 1073741824 Jul 17 14:14:08 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:09 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 1073741824" returned: 0 in 0.778s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:09 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 Jul 17 14:14:09 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:09 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752f62b3-678d-4e92-8306-557367cd2933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f41316-0472-451f-ac0d-c81b7cf93590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Volume volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 (2d75a530-5a64-4a2a-ba7d-f1cc8446e186): created successfully Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f41316-0472-451f-ac0d-c81b7cf93590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Flow 'volume_create_manager' (d33bac84-23a1-4c1b-a368-c303d2a61dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4aecf22f-3c22-4329-9fb1-e9cb424fb5ed tempest-TaggedAttachmentsTest-129751205 None] Created volume successfully. Jul 17 14:14:19 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:14:19 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:25 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:14:25 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:26 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:14:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:14:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 6 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:14:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Flow 'volume_create_manager' (0f1f0196-0cbb-4364-bd98-9fe51b68ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5768311-930a-4817-b324-08114bcb5521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5768311-930a-4817-b324-08114bcb5521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1322333754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4772c9a5-b614-45ef-a624-e95db454eb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8edbdfa5754d6192f5c74cf036da99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:41Z,use_quota=True,user_id='2ccffef274ee4c479506fcb918deca6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32a4242-4253-4e78-ae65-986dd537f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32a4242-4253-4e78-ae65-986dd537f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd0e9d-fc54-4208-9647-19070af5268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd0e9d-fc54-4208-9647-19070af5268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4772c9a5-b614-45ef-a624-e95db454eb5f', 'volume_name': 'volume-4772c9a5-b614-45ef-a624-e95db454eb5f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed3d887-e29c-4e50-98f5-0659ce25e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed3d887-e29c-4e50-98f5-0659ce25e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a2299-4cc6-4a63-9073-dbcc19a00710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:41 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Volume 4772c9a5-b614-45ef-a624-e95db454eb5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4772c9a5-b614-45ef-a624-e95db454eb5f', 'volume_size': 1} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1322333754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4772c9a5-b614-45ef-a624-e95db454eb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8edbdfa5754d6192f5c74cf036da99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:41Z,use_quota=True,user_id='2ccffef274ee4c479506fcb918deca6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Creating volume 4772c9a5-b614-45ef-a624-e95db454eb5f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:14:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:42 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f 1073741824 Jul 17 14:14:42 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Flow 'volume_create_manager' (a3841d88-af55-4c28-9adc-c24031d7afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b8849-47a3-4d36-bf15-e67b991930b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b8849-47a3-4d36-bf15-e67b991930b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1645498658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317b06f-9591-4f79-9873-094127d00b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5f865455484829894f4f44d25b40da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:42Z,use_quota=True,user_id='69b7c20f7fdd47d3adc04430241477d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530e8dd-b465-4879-99ae-7d7088692cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530e8dd-b465-4879-99ae-7d7088692cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c459dbd4-2eb6-4290-91b6-20ba47e8e5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c459dbd4-2eb6-4290-91b6-20ba47e8e5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1317b06f-9591-4f79-9873-094127d00b0c', 'volume_name': 'volume-1317b06f-9591-4f79-9873-094127d00b0c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c28ee5-6867-4ec4-b257-59c5328f603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c28ee5-6867-4ec4-b257-59c5328f603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b36c1b-26f1-4510-991c-f0940f444cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:42 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Volume 1317b06f-9591-4f79-9873-094127d00b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1317b06f-9591-4f79-9873-094127d00b0c', 'volume_size': 1} Jul 17 14:14:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:43 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f 1073741824" returned: 0 in 1.064s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:43 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f Jul 17 14:14:43 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:43 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f" returned: 0 in 0.756s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1645498658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317b06f-9591-4f79-9873-094127d00b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5f865455484829894f4f44d25b40da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:14:42Z,use_quota=True,user_id='69b7c20f7fdd47d3adc04430241477d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Creating volume 1317b06f-9591-4f79-9873-094127d00b0c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:14:43 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:14:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:44 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c 1073741824 Jul 17 14:14:44 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a2299-4cc6-4a63-9073-dbcc19a00710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4772c9a5-b614-45ef-a624-e95db454eb5f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e074038-3dc2-44fc-bb9c-e7ede66e0fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Volume volume-4772c9a5-b614-45ef-a624-e95db454eb5f (4772c9a5-b614-45ef-a624-e95db454eb5f): created successfully Jul 17 14:14:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e074038-3dc2-44fc-bb9c-e7ede66e0fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Flow 'volume_create_manager' (0f1f0196-0cbb-4364-bd98-9fe51b68ba06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9ccf9cfa-d19f-4a31-8eee-d550a7f63a28 tempest-VolumesAdminNegativeTest-1804023496 None] Created volume successfully. Jul 17 14:14:44 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c 1073741824" returned: 0 in 1.036s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:45 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c Jul 17 14:14:45 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:45 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c" returned: 0 in 0.708s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b36c1b-26f1-4510-991c-f0940f444cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1317b06f-9591-4f79-9873-094127d00b0c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af53760-5ee1-4cd0-868b-5a8179cec11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:14:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Volume volume-1317b06f-9591-4f79-9873-094127d00b0c (1317b06f-9591-4f79-9873-094127d00b0c): created successfully Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af53760-5ee1-4cd0-868b-5a8179cec11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:14:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Flow 'volume_create_manager' (a3841d88-af55-4c28-9adc-c24031d7afbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:14:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8938f317-b34e-4925-b64e-78b30159f2ff tempest-DeleteServersTestJSON-2067983118 None] Created volume successfully. Jul 17 14:14:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Acquiring lock "cinder-4772c9a5-b614-45ef-a624-e95db454eb5f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:14:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "cinder-4772c9a5-b614-45ef-a624-e95db454eb5f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:14:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Acquiring lock "cinder-quobyte-4772c9a5-b614-45ef-a624-e95db454eb5f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:14:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "cinder-quobyte-4772c9a5-b614-45ef-a624-e95db454eb5f" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:14:46 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw316u9go/privsep.sock'] Jul 17 14:14:46 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw316u9go/privsep.sock Jul 17 14:14:46 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 14:14:48 devstack cinder-volume[87804]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 17 14:14:49 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:49 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Spawned new privsep daemon via rootwrap Jul 17 14:14:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Accepted privsep connection to /tmp/tmpw316u9go/privsep.sock {{(pid=87804) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 17 14:14:49 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 17 14:14:49 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 17 14:14:49 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 17 14:14:49 devstack cinder-volume[87804]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88922 Jul 17 14:14:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[784be90c-6a50-4f47-8a8d-c51a6b1328ac]: (2,) {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:14:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[10755c12-fb3e-4df3-8858-c27ba2ea978f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:14:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:49 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f Jul 17 14:14:49 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:50 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f" returned: 0 in 1.041s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:50 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f Jul 17 14:14:50 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:51 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4772c9a5-b614-45ef-a624-e95db454eb5f" returned: 0 in 0.907s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "cinder-quobyte-4772c9a5-b614-45ef-a624-e95db454eb5f" released by "delete_volume" :: held 4.672s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:14:51 devstack cinder-volume[87804]: WARNING cinder.quota [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:14:51 devstack cinder-volume[87804]: WARNING cinder.quota [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Created reservations ['bd7efcbc-1d1c-4d08-99e4-50f5b514a4f5', 'cdbde72a-5d91-45b4-b976-d1c55a49b264', '3184be84-a0cb-4827-b47f-536808786c03', 'd6394a75-d00e-467f-8fa3-8e96b5e299b7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:14:51 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:14:51 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:14:52 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Jul 17 14:14:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.838s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:14:52 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:14:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Deleted volume successfully. Jul 17 14:14:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9f54afa0-522a-4710-a32b-1a0d2716097e tempest-VolumesAdminNegativeTest-1804023496 None] Lock "cinder-4772c9a5-b614-45ef-a624-e95db454eb5f-delete_volume" released by "delete_volume" :: held 6.372s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:14:54 devstack cinder-volume[87804]: WARNING py.warnings [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 17 14:14:54 devstack cinder-volume[87804]: .first() Jul 17 14:14:54 devstack cinder-volume[87804]: Jul 17 14:14:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:14:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:14:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:14:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-1317b06f-9591-4f79-9873-094127d00b0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4eb0d35e-65e2-46b1-a88b-b39f545bc349', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:14:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-c021f94c-2e0f-4a93-8d96-92049997e105 req-bf0b2e6d-330f-45c0-9304-b4095c8b0cf6 tempest-DeleteServersTestJSON-2067983118 None] attachment_update completed successfully. Jul 17 14:15:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-5c23b4a0-da06-4ed8-ab01-d03c96c979d2 req-4945978e-a21c-455b-9850-13779dd72585 tempest-DeleteServersTestJSON-2067983118 None] Terminate volume connection completed successfully. Jul 17 14:15:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-5c23b4a0-da06-4ed8-ab01-d03c96c979d2 req-4945978e-a21c-455b-9850-13779dd72585 tempest-DeleteServersTestJSON-2067983118 None] Deleting attachment 4eb0d35e-65e2-46b1-a88b-b39f545bc349. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:15:04 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "cinder-1317b06f-9591-4f79-9873-094127d00b0c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "cinder-1317b06f-9591-4f79-9873-094127d00b0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "cinder-quobyte-1317b06f-9591-4f79-9873-094127d00b0c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "cinder-quobyte-1317b06f-9591-4f79-9873-094127d00b0c" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a9b9c-5f62-40ad-8efa-1a072671ca54]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:05 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c Jul 17 14:15:05 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:05 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c" returned: 0 in 0.445s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:05 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c Jul 17 14:15:05 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:06 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1317b06f-9591-4f79-9873-094127d00b0c" returned: 0 in 0.320s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "cinder-quobyte-1317b06f-9591-4f79-9873-094127d00b0c" released by "delete_volume" :: held 0.816s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Created reservations ['b071acc2-875a-4efb-962d-2e8ff7a7e9a7', 'adb9e085-b994-425f-9a9b-67a570f24f42', '53966b61-d206-478f-8e47-686587d024ee', '2e0f04ad-5310-4ef3-95b2-fc7031b9414f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:06 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:15:06 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:06 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.406s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:15:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Deleted volume successfully. Jul 17 14:15:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e5704f5f-659c-4075-895a-4a3f6e81d031 tempest-DeleteServersTestJSON-2067983118 None] Lock "cinder-1317b06f-9591-4f79-9873-094127d00b0c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:15:16 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=27,cinder:SELECT=20,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:15:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:15:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:25 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:15:25 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:26 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.622s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:15:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c05c0480-d032-4b19-b0f5-077b85c13a30 req-dbf4914a-b941-4ab3-9a51-aa68e722f85c tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:15:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c05c0480-d032-4b19-b0f5-077b85c13a30 req-dbf4914a-b941-4ab3-9a51-aa68e722f85c tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:15:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-c05c0480-d032-4b19-b0f5-077b85c13a30 req-dbf4914a-b941-4ab3-9a51-aa68e722f85c tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:15:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-c05c0480-d032-4b19-b0f5-077b85c13a30 req-dbf4914a-b941-4ab3-9a51-aa68e722f85c tempest-TaggedAttachmentsTest-129751205 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c81c08d-b885-4c39-829e-fc1997891877', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:15:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-c05c0480-d032-4b19-b0f5-077b85c13a30 req-dbf4914a-b941-4ab3-9a51-aa68e722f85c tempest-TaggedAttachmentsTest-129751205 None] attachment_update completed successfully. Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Flow 'volume_create_manager' (cc654d87-c14f-47ec-b1c4-2932c286c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d06b89-c868-4660-8d0a-a42d2f55e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d06b89-c868-4660-8d0a-a42d2f55e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2127187715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036b3412-97ce-4c8f-9a94-7253e9e2edd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9675eb2984234bbab54d09570a42ed63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:15:48Z,use_quota=True,user_id='63182d89944742e0be89eb7bf7ad5f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12246798-1dfa-4add-b481-1ae64b371fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12246798-1dfa-4add-b481-1ae64b371fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e458a4-740d-4bc8-8b77-506912ea5053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e458a4-740d-4bc8-8b77-506912ea5053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036b3412-97ce-4c8f-9a94-7253e9e2edd4', 'volume_name': 'volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d54c42-18d6-4133-b476-650393dc3f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d54c42-18d6-4133-b476-650393dc3f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc44df7-e037-48d9-8567-2315e0eabbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Volume 036b3412-97ce-4c8f-9a94-7253e9e2edd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4', 'volume_size': 1} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2127187715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036b3412-97ce-4c8f-9a94-7253e9e2edd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9675eb2984234bbab54d09570a42ed63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:15:48Z,use_quota=True,user_id='63182d89944742e0be89eb7bf7ad5f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Creating volume 036b3412-97ce-4c8f-9a94-7253e9e2edd4 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:15:48 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:15:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:48 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 1073741824 Jul 17 14:15:48 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:49 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 1073741824" returned: 0 in 0.832s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:15:49 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 Jul 17 14:15:49 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:15:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-db09b2a5-19c5-4bad-aa85-35216623bd58 req-b825c8fd-d80e-4635-a102-2ebe56f951eb tempest-TaggedAttachmentsTest-129751205 None] Terminate volume connection completed successfully. Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-db09b2a5-19c5-4bad-aa85-35216623bd58 req-b825c8fd-d80e-4635-a102-2ebe56f951eb tempest-TaggedAttachmentsTest-129751205 None] Deleting attachment 2c81c08d-b885-4c39-829e-fc1997891877. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:15:50 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4" returned: 0 in 0.951s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc44df7-e037-48d9-8567-2315e0eabbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53ccb83-a8e2-434a-9d27-ecbe747c8705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:15:50 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Volume volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 (036b3412-97ce-4c8f-9a94-7253e9e2edd4): created successfully Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53ccb83-a8e2-434a-9d27-ecbe747c8705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:15:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Flow 'volume_create_manager' (cc654d87-c14f-47ec-b1c4-2932c286c923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:15:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ff9d0c87-3195-4a55-9d4d-939932d96396 tempest-ServerRescueNegativeTestJSON-1111991202 None] Created volume successfully. Jul 17 14:16:00 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:16:00 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:16:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Acquiring lock "cinder-036b3412-97ce-4c8f-9a94-7253e9e2edd4-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "cinder-036b3412-97ce-4c8f-9a94-7253e9e2edd4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "cinder-2d75a530-5a64-4a2a-ba7d-f1cc8446e186-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "cinder-2d75a530-5a64-4a2a-ba7d-f1cc8446e186-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Acquiring lock "cinder-quobyte-036b3412-97ce-4c8f-9a94-7253e9e2edd4" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "cinder-quobyte-036b3412-97ce-4c8f-9a94-7253e9e2edd4" acquired by "delete_volume" :: waited 0.043s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[01899c7a-4ce5-4fd1-b966-34c1f0677e59]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "cinder-quobyte-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "cinder-quobyte-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" acquired by "delete_volume" :: waited 0.087s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a4986-3df3-4942-b91b-6fd0937294ed]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:13 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 Jul 17 14:16:13 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:13 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 Jul 17 14:16:13 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:14 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4" returned: 0 in 0.995s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:14 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" returned: 0 in 0.797s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:14 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186 Jul 17 14:16:14 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:14 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4 Jul 17 14:16:14 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:14 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-036b3412-97ce-4c8f-9a94-7253e9e2edd4" returned: 0 in 0.423s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:14 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" returned: 0 in 0.432s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "cinder-quobyte-036b3412-97ce-4c8f-9a94-7253e9e2edd4" released by "delete_volume" :: held 1.563s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "cinder-quobyte-2d75a530-5a64-4a2a-ba7d-f1cc8446e186" released by "delete_volume" :: held 1.368s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Created reservations ['831163af-93cb-4e97-b113-797400831627', '7c4685a2-e819-40e5-87cb-03b6d9743a91', '5803d54a-a67e-4445-9323-631ec70d435b', 'acb94e18-229a-4e3c-b65c-d94733605e61'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Created reservations ['d79bad93-940b-410e-a628-1bcc9466adc5', 'e5424a8a-852f-421b-bfbc-3e87d73ec101', 'f09b7812-8492-4f55-9fb6-a4c8ad2702e5', 'e4b18f61-6309-4c5c-93f1-6213bd8dd215'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:15 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:16:15 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:15 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:16:15 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:16 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.914s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:16:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Deleted volume successfully. Jul 17 14:16:16 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.886s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4e387ddb-e8d3-452e-b667-85a52ce0ca55 tempest-ServerRescueNegativeTestJSON-1111991202 None] Lock "cinder-036b3412-97ce-4c8f-9a94-7253e9e2edd4-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Deleted volume successfully. Jul 17 14:16:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-40dbfd71-ea7f-4baf-ac2c-92a824517c39 tempest-TaggedAttachmentsTest-129751205 None] Lock "cinder-2d75a530-5a64-4a2a-ba7d-f1cc8446e186-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=8,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:16:25 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:16:25 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:25 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.322s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 8 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:16:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:16:26 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=14,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Flow 'volume_create_manager' (bfc67d97-7b60-4185-9d03-f0c34e450c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a584bc9-6355-4e2a-97d9-9884df310e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a584bc9-6355-4e2a-97d9-9884df310e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-685096857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e57cf8-03fa-4f4c-b4d7-922f0494a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e682302fc8945d98fcadd530a5fee11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:32Z,use_quota=True,user_id='2369845e49c64c30a4669f7c452481b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b1f114-5caa-44ed-82d9-987a55cc9198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b1f114-5caa-44ed-82d9-987a55cc9198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89295d97-47c4-4e8a-bd40-63ebd7857597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89295d97-47c4-4e8a-bd40-63ebd7857597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'volume_name': 'volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a8985-e4d2-4ff4-91d7-8a4db6a9902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a8985-e4d2-4ff4-91d7-8a4db6a9902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8fa8b9-7aed-4637-b251-5c833c85f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Volume 14e57cf8-03fa-4f4c-b4d7-922f0494a9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'volume_size': 1} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-685096857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e57cf8-03fa-4f4c-b4d7-922f0494a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e682302fc8945d98fcadd530a5fee11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:32Z,use_quota=True,user_id='2369845e49c64c30a4669f7c452481b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Creating volume 14e57cf8-03fa-4f4c-b4d7-922f0494a9ba {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:32 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:32 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba 1073741824 Jul 17 14:16:32 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:32 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba 1073741824" returned: 0 in 0.600s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:32 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba Jul 17 14:16:32 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:33 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" returned: 0 in 0.318s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8fa8b9-7aed-4637-b251-5c833c85f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37085aba-f541-4415-bcaf-2261814dbddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:33 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Volume volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba (14e57cf8-03fa-4f4c-b4d7-922f0494a9ba): created successfully Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37085aba-f541-4415-bcaf-2261814dbddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Flow 'volume_create_manager' (bfc67d97-7b60-4185-9d03-f0c34e450c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4aec7a69-9f6f-4642-8120-3f4817721b51 tempest-ServerActionsTestOtherA-620145997 None] Created volume successfully. Jul 17 14:16:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-368d2e97-c693-43e5-bde5-b8a8bb28f43e tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-1381704968: creating Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Flow 'volume_create_manager' (88e2a126-fe03-49c7-98cf-d0a94e2a4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558e03fa-90dc-4f6f-b20d-7af84841e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558e03fa-90dc-4f6f-b20d-7af84841e43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-736811001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6181e-ea13-4806-b88e-e50017b0e32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3897e109d5ad44038dc8039b3791d67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:35Z,use_quota=True,user_id='0ca44d21239342db89f53f6cc9cd2d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e47a61-afd8-45ce-ba04-96bbbded9359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e47a61-afd8-45ce-ba04-96bbbded9359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e06ae18-13d3-4b35-902a-9f1700729db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e06ae18-13d3-4b35-902a-9f1700729db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd6181e-ea13-4806-b88e-e50017b0e32b', 'volume_name': 'volume-afd6181e-ea13-4806-b88e-e50017b0e32b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a255ec4b-8e36-45a4-ad78-a015a3994890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a255ec4b-8e36-45a4-ad78-a015a3994890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9a625f-091f-4b35-aef4-3ff47eb45905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:35 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Volume afd6181e-ea13-4806-b88e-e50017b0e32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd6181e-ea13-4806-b88e-e50017b0e32b', 'volume_size': 1} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-736811001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6181e-ea13-4806-b88e-e50017b0e32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3897e109d5ad44038dc8039b3791d67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:35Z,use_quota=True,user_id='0ca44d21239342db89f53f6cc9cd2d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Creating volume afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:35 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-368d2e97-c693-43e5-bde5-b8a8bb28f43e tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-1381704968: created successfully Jul 17 14:16:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-368d2e97-c693-43e5-bde5-b8a8bb28f43e tempest-GroupSnapshotsTest-603598133 None] Create group completed successfully. Jul 17 14:16:35 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b 1073741824 Jul 17 14:16:35 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:35 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b 1073741824" returned: 0 in 0.558s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:35 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b Jul 17 14:16:35 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:36 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9a625f-091f-4b35-aef4-3ff47eb45905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd6181e-ea13-4806-b88e-e50017b0e32b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e199358a-2db4-4c6c-9659-56f36065456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Volume volume-afd6181e-ea13-4806-b88e-e50017b0e32b (afd6181e-ea13-4806-b88e-e50017b0e32b): created successfully Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e199358a-2db4-4c6c-9659-56f36065456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Flow 'volume_create_manager' (88e2a126-fe03-49c7-98cf-d0a94e2a4774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-a12e0a2f-de6a-4af2-a96b-0e6f1df1e4ca req-29307000-b67b-434f-97c5-10e91f726dd7 tempest-VolumesSnapshotsTestJSON-2117463480 None] Created volume successfully. Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (68a2737f-eddc-433d-95fb-eaeed4481747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86c62ec-e628-4157-8937-be33548709d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86c62ec-e628-4157-8937-be33548709d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1885167860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c67da4f-6ce9-40cc-896a-d4b49352f6bf,host='devstack@QuobyteHD#QuobyteHD',id=8dd4a15e-53c5-4471-bbc6-4200cc89db5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:37Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1156bb97-2df0-4ec2-aa56-dbca4969833e),volume_type_id=1156bb97-2df0-4ec2-aa56-dbca4969833e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6f0d0e-ed6e-4cba-8df0-c72ddcec6996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6f0d0e-ed6e-4cba-8df0-c72ddcec6996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a3af01-1e51-4fb7-8e94-36bb33059502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a3af01-1e51-4fb7-8e94-36bb33059502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd4a15e-53c5-4471-bbc6-4200cc89db5e', 'volume_name': 'volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8f67bb-a25e-430b-933a-e6913f28d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8f67bb-a25e-430b-933a-e6913f28d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a5ade7-a07b-4138-8856-2f09ebc29310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Volume 8dd4a15e-53c5-4471-bbc6-4200cc89db5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e', 'volume_size': 1} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c67da4f-6ce9-40cc-896a-d4b49352f6bf,created_at=2026-07-17T12:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1885167860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c67da4f-6ce9-40cc-896a-d4b49352f6bf,host='devstack@QuobyteHD#QuobyteHD',id=8dd4a15e-53c5-4471-bbc6-4200cc89db5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:37Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1156bb97-2df0-4ec2-aa56-dbca4969833e),volume_type_id=1156bb97-2df0-4ec2-aa56-dbca4969833e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Creating volume 8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:36 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:16:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:36 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e 1073741824 Jul 17 14:16:36 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:37 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e 1073741824" returned: 0 in 0.652s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:37 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:16:37 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:37 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.461s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.408s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a5ade7-a07b-4138-8856-2f09ebc29310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0659f6fb-3d1a-4bcf-9a4c-c765fab87629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Creating offline snapshot 7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 of volume afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:16:38 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Volume volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e (8dd4a15e-53c5-4471-bbc6-4200cc89db5e): created successfully Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0659f6fb-3d1a-4bcf-9a4c-c765fab87629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (68a2737f-eddc-433d-95fb-eaeed4481747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2837a188-4508-4def-9a7b-848df669cb3f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-33d4b9f6-a6c9-4819-9d18-2b71718c5adf tempest-GroupSnapshotsTest-603598133 None] Created volume successfully. Jul 17 14:16:38 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b Jul 17 14:16:38 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:38 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b" returned: 0 in 0.537s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:38 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 1G Jul 17 14:16:38 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:39 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 1G" returned: 0 in 0.525s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6181e-ea13-4806-b88e-e50017b0e32b -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:39 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6181e-ea13-4806-b88e-e50017b0e32b -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 Jul 17 14:16:39 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] GroupSnapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: creating. Jul 17 14:16:39 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6181e-ea13-4806-b88e-e50017b0e32b -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" returned: 0 in 0.450s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:39 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 is being set with open permissions: ugo+rw Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:39 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 Jul 17 14:16:39 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Group snapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: creating. {{(pid=87804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:39 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" returned: 0 in 0.363s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:40 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info Jul 17 14:16:40 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:40 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info" returned: 0 in 0.286s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:40 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info is being set with open permissions: ugo+rw Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:40 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info Jul 17 14:16:40 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:40 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.info" returned: 0 in 0.401s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.096s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Creating offline snapshot 0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe of volume 8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20cfb5-52a5-4929-9171-9d1cbb25556a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:40 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-693197ff-22e5-4119-83a6-6cdb52205374 req-e9675ff1-97ce-49be-bda2-0e770be22525 tempest-VolumesSnapshotsTestJSON-2117463480 None] Create snapshot completed successfully Jul 17 14:16:41 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:16:41 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "cinder-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "cinder-quobyte-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:41 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.668s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Deleting offline snapshot 7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 of volume afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:16:41 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe 1G Jul 17 14:16:41 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] snapshot_file for this snap is: volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1dfff0-0455-468f-b640-abc782b78b8d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:41 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 Jul 17 14:16:41 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:42 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:42 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd6181e-ea13-4806-b88e-e50017b0e32b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe 1G" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33348f-2f19-4647-806c-1e7ae614b104]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:42 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:16:42 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:42 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b Jul 17 14:16:42 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:42 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.538s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:42 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:42 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:16:42 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:42 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b" returned: 0 in 0.738s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:42 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 Jul 17 14:16:42 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:43 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.421s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:43 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info Jul 17 14:16:43 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:43 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" returned: 0 in 0.516s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:43 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451 Jul 17 14:16:43 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Flow 'volume_create_manager' (ac3a3211-114d-46db-a7b3-23a7b70b3fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ef4a81-c9d0-4d96-a56b-3850d4a6b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ef4a81-c9d0-4d96-a56b-3850d4a6b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-80443002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebf7534-b766-4c50-97fa-bd35dc0c95af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52ec31c8ba74a31a7dc9102262e0272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:43Z,use_quota=True,user_id='b2d9f0c827074a99a075f94a94b068b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d8a8db-5f9c-481d-86cc-46df94679b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d8a8db-5f9c-481d-86cc-46df94679b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e8ac38-6278-4714-ad9f-1fd18483fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e8ac38-6278-4714-ad9f-1fd18483fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebf7534-b766-4c50-97fa-bd35dc0c95af', 'volume_name': 'volume-aebf7534-b766-4c50-97fa-bd35dc0c95af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:43 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de2432d-143f-4f0c-902e-09edfbef66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de2432d-143f-4f0c-902e-09edfbef66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af14b70-bb14-417f-8e2f-ea19bffbfae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Volume aebf7534-b766-4c50-97fa-bd35dc0c95af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebf7534-b766-4c50-97fa-bd35dc0c95af', 'volume_size': 1} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:43 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:43 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info Jul 17 14:16:43 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:43 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b.7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" returned: 0 in 0.462s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451" released by "_delete_snapshot" :: held 2.414s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:43 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" released by "delete_snapshot" :: held 2.487s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.info" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.239s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-80443002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebf7534-b766-4c50-97fa-bd35dc0c95af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52ec31c8ba74a31a7dc9102262e0272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:43Z,use_quota=True,user_id='b2d9f0c827074a99a075f94a94b068b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Creating volume aebf7534-b766-4c50-97fa-bd35dc0c95af {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:43 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:16:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:44 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af 1073741824 Jul 17 14:16:44 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:44 devstack cinder-volume[87804]: WARNING cinder.quota [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.quota [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Created reservations ['909f56fc-f730-4e30-988a-2e4e4b41ff81', '845396d7-53ae-42a0-931f-6dd9dd3ae213', 'e8ac8063-1e44-4c91-a716-0d4cd2da36d7', '1d66f35d-3bde-4134-9d2a-1cd7779314ad'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8b34c7a4-add7-4a56-a354-ba418c79393f tempest-GroupSnapshotsTest-603598133 None] group_snapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: created successfully Jul 17 14:16:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Delete snapshot completed successfully. Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-4ec86d37-d4d4-46ad-9c50-35edcf83dbe4 req-e5aef459-bb92-4891-8874-ea93fa172226 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-7c3edd0c-a3a4-44de-be9a-6fc3a4c61451-delete_snapshot" released by "delete_snapshot" :: held 2.864s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:44 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af 1073741824" returned: 0 in 0.532s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:44 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af Jul 17 14:16:44 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:44 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af" returned: 0 in 0.293s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af14b70-bb14-417f-8e2f-ea19bffbfae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebf7534-b766-4c50-97fa-bd35dc0c95af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effff7fa-cccd-4974-ae6d-980f2467e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Volume volume-aebf7534-b766-4c50-97fa-bd35dc0c95af (aebf7534-b766-4c50-97fa-bd35dc0c95af): created successfully Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effff7fa-cccd-4974-ae6d-980f2467e06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Flow 'volume_create_manager' (ac3a3211-114d-46db-a7b3-23a7b70b3fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f0eb6534-ec2e-471f-9bbc-11e0b17b25d4 tempest-AttachVolumeShelveTestJSON-730019975 None] Created volume successfully. Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "cinder-afd6181e-ea13-4806-b88e-e50017b0e32b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-afd6181e-ea13-4806-b88e-e50017b0e32b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" acquired by "delete_volume" :: waited 0.045s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b57ee9-924b-4855-b199-fd798fb093da]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:45 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b Jul 17 14:16:45 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe-1ed8ce09-f830-4e48-a3a3-e75255061f02" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe-1ed8ce09-f830-4e48-a3a3-e75255061f02" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Creating volume 1ed8ce09-f830-4e48-a3a3-e75255061f02 from snapshot 0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:46 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b" returned: 0 in 0.726s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] snapshot: 0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe, volume: 1ed8ce09-f830-4e48-a3a3-e75255061f02, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:46 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b Jul 17 14:16:46 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d6454-0f12-4227-91d3-f12295605e06]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:46 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:16:46 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:47 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-afd6181e-ea13-4806-b88e-e50017b0e32b" returned: 0 in 0.630s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-quobyte-afd6181e-ea13-4806-b88e-e50017b0e32b" released by "delete_volume" :: held 1.493s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.quota [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Created reservations ['3fdeacd8-b8bd-4565-bff6-81417fe38bb5', '11fdb9a9-34ed-414b-a7b6-e16c4dc9982e', 'df447fe8-53a1-4813-9cfb-ee8c1b4aad98', '0385ead1-d811-4c3c-a3b7-1f0bb79b2783'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:47 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.765s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4912d-ed74-4ab1-a2b9-155a8a105439]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:47 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:16:47 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:47 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:16:47 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:47 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.420s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.manager [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:16:47 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.527s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Deleted volume successfully. Jul 17 14:16:47 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 Jul 17 14:16:47 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-27b4c93c-a471-45db-9898-832694932774 req-562f0dcb-8757-45f8-9122-d398dfbeef41 tempest-VolumesSnapshotsTestJSON-2117463480 None] Lock "cinder-afd6181e-ea13-4806-b88e-e50017b0e32b-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:56 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02" returned: 0 in 8.568s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[332690bf-eaea-4749-9538-ee00b31b7394]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:56 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:16:56 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:57 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.697s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:16:57 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Converted 1024.00 MB image at 119.50 MB/s Jul 17 14:16:57 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:57 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 Jul 17 14:16:57 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=36,cinder:INSERT=4,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:16:57 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02" returned: 0 in 0.282s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" released by "_copy_volume_from_snapshot" :: held 11.021s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe-1ed8ce09-f830-4e48-a3a3-e75255061f02" released by "_create_volume_from_snapshot" :: held 11.110s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.138s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1cd9f1c1-70d1-4779-81f8-0b8fdbd066ac tempest-GroupSnapshotsTest-603598133 None] Create group from source-snapshot-b630da84-0d3d-43c3-bcf9-fbcc802274e2 completed successfully. Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" acquired by "delete_volume" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075afbe-257a-4b89-8d77-77b1282605ab]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:58 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 Jul 17 14:16:58 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (1ef80ffb-fb17-4297-b00d-40b2b1dc1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba92984d-1288-4f2f-b7ba-6188bb9e43f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba92984d-1288-4f2f-b7ba-6188bb9e43f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-161326527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e37e2c-7afa-49a0-8777-3317b8bbfa3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:59Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d921b125-e7bb-42b8-91df-85bbe8520518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d921b125-e7bb-42b8-91df-85bbe8520518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb74bd9-5542-4d79-a0a5-f58c890e4c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb74bd9-5542-4d79-a0a5-f58c890e4c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e37e2c-7afa-49a0-8777-3317b8bbfa3c', 'volume_name': 'volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf3c969-bc4d-49b1-991c-3ce8fce3fb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf3c969-bc4d-49b1-991c-3ce8fce3fb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bfd4cc-d2b6-4881-b74d-3aa49f552fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Volume e8e37e2c-7afa-49a0-8777-3317b8bbfa3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c', 'volume_size': 1} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-161326527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e37e2c-7afa-49a0-8777-3317b8bbfa3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:16:59Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Creating volume e8e37e2c-7afa-49a0-8777-3317b8bbfa3c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:16:58 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:58 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c 1073741824 Jul 17 14:16:58 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:58 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02" returned: 0 in 0.481s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:59 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02 Jul 17 14:16:59 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:59 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1ed8ce09-f830-4e48-a3a3-e75255061f02" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-1ed8ce09-f830-4e48-a3a3-e75255061f02" released by "delete_volume" :: held 0.875s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:16:59 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c 1073741824" returned: 0 in 0.510s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Created reservations ['3292bd87-2d0a-4062-a6e5-cb8d9af38e6f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:59 devstack cinder-volume[87804]: WARNING cinder.quota [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-869083946 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-869083946, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:16:59 devstack cinder-volume[87804]: WARNING cinder.quota [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-869083946 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-869083946, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:16:59 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c Jul 17 14:16:59 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Created reservations ['dc3e920b-faeb-49d7-a34f-6285c4752328', '62282ad0-3f41-4880-b7f9-076b1e9c9261', 'f39b10be-3199-4a07-97cd-67d2beadb3f0', '8f578300-a35e-481e-a5f5-7550ea64d597'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:59 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:16:59 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:16:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] group_snapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: deleting Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] group_snapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: deleting {{(pid=87804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Deleting offline snapshot 0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe of volume 8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:16:59 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] snapshot_file for this snap is: volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" returned: 0 in 0.468s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bfd4cc-d2b6-4881-b74d-3aa49f552fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b464121-7199-4bba-9792-dbe2ec7d22d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b348e15-0fc0-47e3-bf94-96f8e4bc7bba]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:16:59 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:16:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-52a04a75-9290-4500-83cf-5be4127480b6 tempest-GroupSnapshotsTest-603598133 None] Delete group completed successfully. Jul 17 14:16:59 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Volume volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c (e8e37e2c-7afa-49a0-8777-3317b8bbfa3c): created successfully Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b464121-7199-4bba-9792-dbe2ec7d22d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:16:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (1ef80ffb-fb17-4297-b00d-40b2b1dc1051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4be69f4b-d311-40ba-87f9-ecaafb843ef5 tempest-VolumesTestJSON-1551210174 None] Created volume successfully. Jul 17 14:17:00 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:17:00 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:00 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.428s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf029054-998b-4d47-8077-186b797a64ca]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:00 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:17:00 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:00 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.551s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:00 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:17:00 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:01 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.736s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:01 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe Jul 17 14:17:01 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (820b9302-7669-4684-be0d-e18d1ded8ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4a48d8-ddb2-484f-85ca-6c8e62c95d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4a48d8-ddb2-484f-85ca-6c8e62c95d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1926404456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec9754e-957b-4bef-bd4f-2dd0053826c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:02Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c49179-57ed-439d-b488-1c82b367b926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c49179-57ed-439d-b488-1c82b367b926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043bee09-f722-4525-af2a-18ae4942f813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043bee09-f722-4525-af2a-18ae4942f813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec9754e-957b-4bef-bd4f-2dd0053826c5', 'volume_name': 'volume-cec9754e-957b-4bef-bd4f-2dd0053826c5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66165a9f-f122-4fd5-96f1-e012a2a4a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66165a9f-f122-4fd5-96f1-e012a2a4a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891bb459-e2d6-4e46-b829-3d37b46511fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Volume cec9754e-957b-4bef-bd4f-2dd0053826c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec9754e-957b-4bef-bd4f-2dd0053826c5', 'volume_size': 1} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1926404456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec9754e-957b-4bef-bd4f-2dd0053826c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:02Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Creating volume cec9754e-957b-4bef-bd4f-2dd0053826c5 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:02 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:02 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e.0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:02 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 1073741824 Jul 17 14:17:02 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-0be0bd6e-ed2d-42c9-88f9-bcf56c0ffcfe" released by "_delete_snapshot" :: held 2.251s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" released by "delete_snapshot" :: held 2.298s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:02 devstack cinder-volume[87804]: WARNING cinder.quota [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-869083946 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-869083946, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] Created reservations ['bb947b27-f5e1-49da-8cec-09d4ac4645df', 'c5736edd-da74-4a5a-a373-6698aea1fe05', '7eb1e2fa-0545-4899-8d10-937812ffc4c6', '87575905-b886-416e-b5b9-8577b4887d1d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e89f6170-02ed-47b3-8e1b-b816fdc4a1da tempest-GroupSnapshotsTest-603598133 None] group_snapshot b630da84-0d3d-43c3-bcf9-fbcc802274e2: deleted successfully Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-0b426f08-f6d4-4795-b10d-04964fc0d4d8 req-9f170da1-7245-41a5-863e-88bce4ef0072 tempest-AttachVolumeShelveTestJSON-730019975 None] No connector for attachment a8d54918-ad8f-4826-bd9b-840941ff4a41; skipping storage backend terminate_connection call. {{(pid=87804) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-0b426f08-f6d4-4795-b10d-04964fc0d4d8 req-9f170da1-7245-41a5-863e-88bce4ef0072 tempest-AttachVolumeShelveTestJSON-730019975 None] Deleting attachment a8d54918-ad8f-4826-bd9b-840941ff4a41. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:17:02 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 1073741824" returned: 0 in 0.772s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:02 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 Jul 17 14:17:02 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:03 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891bb459-e2d6-4e46-b829-3d37b46511fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec9754e-957b-4bef-bd4f-2dd0053826c5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dc2fa9-b29f-4215-be3e-7b66d4f5ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Volume volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 (cec9754e-957b-4bef-bd4f-2dd0053826c5): created successfully Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dc2fa9-b29f-4215-be3e-7b66d4f5ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (820b9302-7669-4684-be0d-e18d1ded8ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cad96d3f-0a06-4dc3-85d7-d6128b50a7dc tempest-VolumesTestJSON-1551210174 None] Created volume successfully. Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe4e4f-d450-4c9a-9aaf-bc1e8cf81dd1]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:04 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:17:04 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:04 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.549s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:04 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e Jul 17 14:17:04 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:04 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (6ab0d764-ba6b-4597-9d59-f62314d07ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9cdd12-a43c-42f5-a119-d2c5e53c01be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" returned: 0 in 0.319s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9cdd12-a43c-42f5-a119-d2c5e53c01be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1802414785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c837086-9e34-45ab-a6d0-5d4acb9fc8a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:05Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616d3a88-318a-43bb-8e2d-dd286076f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616d3a88-318a-43bb-8e2d-dd286076f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d03d5ef-3c3a-47bf-b38f-1ffeeb075f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d03d5ef-3c3a-47bf-b38f-1ffeeb075f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c837086-9e34-45ab-a6d0-5d4acb9fc8a6', 'volume_name': 'volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1359970c-6650-4c39-9ccd-12bc7f051b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1359970c-6650-4c39-9ccd-12bc7f051b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de564a-e378-429d-a764-906f2a513290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Volume 1c837086-9e34-45ab-a6d0-5d4acb9fc8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6', 'volume_size': 1} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1802414785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c837086-9e34-45ab-a6d0-5d4acb9fc8a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='444fc70e027c41cf9079bb27fa5d67be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:05Z,use_quota=True,user_id='03cb090a41144c0eb7c04172d21ee03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Creating volume 1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:04 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-8dd4a15e-53c5-4471-bbc6-4200cc89db5e" released by "delete_volume" :: held 1.071s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:04 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 1073741824 Jul 17 14:17:04 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Created reservations ['0baf454e-304f-4b12-b827-8e495acce739'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:05 devstack cinder-volume[87804]: WARNING cinder.db.api [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-869083946'] Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Created reservations ['eb5ec425-0663-4773-93a3-da2a7e58ce6f', '5275d6b1-279a-49be-9728-03865bc47eed', 'f25a0819-84ca-40f8-812d-b7ac9b71a78b', '63fbff25-9f96-463a-ba77-4d534e3776c3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:05 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:05 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:05 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.381s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-863d8828-785c-411a-9ec1-58c884d5c3d1 tempest-GroupSnapshotsTest-603598133 None] Delete group completed successfully. Jul 17 14:17:05 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 1073741824" returned: 0 in 0.865s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:05 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 Jul 17 14:17:05 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:06 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-52b50a77-a7f4-43cf-b460-52788be47688 tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-1113519273: creating Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de564a-e378-429d-a764-906f2a513290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73b2e29-36bb-4d4e-a862-668d4795091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:06 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Volume volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 (1c837086-9e34-45ab-a6d0-5d4acb9fc8a6): created successfully Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73b2e29-36bb-4d4e-a862-668d4795091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Flow 'volume_create_manager' (6ab0d764-ba6b-4597-9d59-f62314d07ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-52b50a77-a7f4-43cf-b460-52788be47688 tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-1113519273: created successfully Jul 17 14:17:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b2bfbd95-692c-4c5b-9677-c4b4270cc967 tempest-VolumesTestJSON-1551210174 None] Created volume successfully. Jul 17 14:17:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-52b50a77-a7f4-43cf-b460-52788be47688 tempest-GroupSnapshotsTest-603598133 None] Create group completed successfully. Jul 17 14:17:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-4db7fd2c-87b0-46e3-8829-1e45d2a0dabf req-557c279e-771d-46da-895d-b831c996afe0 tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-4db7fd2c-87b0-46e3-8829-1e45d2a0dabf req-557c279e-771d-46da-895d-b831c996afe0 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-4db7fd2c-87b0-46e3-8829-1e45d2a0dabf req-557c279e-771d-46da-895d-b831c996afe0 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-4db7fd2c-87b0-46e3-8829-1e45d2a0dabf req-557c279e-771d-46da-895d-b831c996afe0 tempest-ServerActionsTestOtherA-620145997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee85701b-dbf7-411e-ad7c-ae5a6eb5eacf', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:17:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-4db7fd2c-87b0-46e3-8829-1e45d2a0dabf req-557c279e-771d-46da-895d-b831c996afe0 tempest-ServerActionsTestOtherA-620145997 None] attachment_update completed successfully. Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (75339ffc-4b53-4eb2-8548-02eddc99c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285ccf57-ee1d-4f8d-a427-7018a8af718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285ccf57-ee1d-4f8d-a427-7018a8af718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306843453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,host='devstack@QuobyteHD#QuobyteHD',id=673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:08Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c6ceeb-79b8-4767-901b-75403e3be309),volume_type_id=54c6ceeb-79b8-4767-901b-75403e3be309)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8850a8f9-c897-4a69-ad5a-c4997cfaa0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8850a8f9-c897-4a69-ad5a-c4997cfaa0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7305f0-0c37-48a7-a99e-9bcd6d20742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7305f0-0c37-48a7-a99e-9bcd6d20742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd', 'volume_name': 'volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f36982-138d-4c44-abc1-fa3c0d18af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f36982-138d-4c44-abc1-fa3c0d18af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba6cdd7-e631-4c9d-adf1-be450d343452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Volume 673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd', 'volume_size': 1} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,created_at=2026-07-17T12:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306843453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,host='devstack@QuobyteHD#QuobyteHD',id=673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:08Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c6ceeb-79b8-4767-901b-75403e3be309),volume_type_id=54c6ceeb-79b8-4767-901b-75403e3be309)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Creating volume 673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:08 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:08 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd 1073741824 Jul 17 14:17:08 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-quobyte-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c2c86-21ea-4af9-9848-9f8bef68c75f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:08 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 Jul 17 14:17:08 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:08 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd 1073741824" returned: 0 in 0.689s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:09 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd Jul 17 14:17:09 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:09 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" returned: 0 in 0.548s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:09 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6 Jul 17 14:17:09 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:09 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" returned: 0 in 0.568s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:09 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba6cdd7-e631-4c9d-adf1-be450d343452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54db447-af7b-47f0-a605-dc8f840bec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" returned: 0 in 0.543s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6" released by "delete_volume" :: held 1.185s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Volume volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd (673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd): created successfully Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54db447-af7b-47f0-a605-dc8f840bec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (75339ffc-4b53-4eb2-8548-02eddc99c41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ad97c8b1-44c4-4a19-98e7-15d4436561f5 tempest-GroupSnapshotsTest-603598133 None] Created volume successfully. Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Created reservations ['b1139812-917e-4799-a1c6-dcc8cebc09ac', '579930dd-eefa-4242-9a2a-caf86dd43d7b', 'b688fb8f-29b7-430d-a73b-f6acb4a4ddd2', 'ed6929bf-870a-4154-bcef-c01625987870'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:10 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:10 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:10 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.369s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Deleted volume successfully. Jul 17 14:17:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e9621af-131c-46d7-b8a8-0e448f762817 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-1c837086-9e34-45ab-a6d0-5d4acb9fc8a6-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-cec9754e-957b-4bef-bd4f-2dd0053826c5-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-cec9754e-957b-4bef-bd4f-2dd0053826c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-quobyte-cec9754e-957b-4bef-bd4f-2dd0053826c5" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-cec9754e-957b-4bef-bd4f-2dd0053826c5" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b48235-3e5f-4320-bf12-13e740de8930]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:11 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 Jul 17 14:17:11 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:11 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5" returned: 0 in 0.631s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:11 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5 Jul 17 14:17:11 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:12 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cec9754e-957b-4bef-bd4f-2dd0053826c5" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (f4a65f4f-cac8-4f35-80a5-e1379aa4049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38f42d9-8fb9-4553-a759-2bf4564e21c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-cec9754e-957b-4bef-bd4f-2dd0053826c5" released by "delete_volume" :: held 1.186s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38f42d9-8fb9-4553-a759-2bf4564e21c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146049020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,host='devstack@QuobyteHD#QuobyteHD',id=69c3fd88-1fec-46cb-9309-aa62726e89bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:12Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c6ceeb-79b8-4767-901b-75403e3be309),volume_type_id=54c6ceeb-79b8-4767-901b-75403e3be309)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccabc86-ca73-4b72-a0c9-09b0a2ec06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccabc86-ca73-4b72-a0c9-09b0a2ec06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a749f24-fde6-425d-abd3-ff990b938edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a749f24-fde6-425d-abd3-ff990b938edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c3fd88-1fec-46cb-9309-aa62726e89bf', 'volume_name': 'volume-69c3fd88-1fec-46cb-9309-aa62726e89bf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2160498b-8f9a-462b-b263-460e0309e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2160498b-8f9a-462b-b263-460e0309e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14423ed0-1993-472e-8cfc-30f9d764e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Volume 69c3fd88-1fec-46cb-9309-aa62726e89bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c3fd88-1fec-46cb-9309-aa62726e89bf', 'volume_size': 1} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,created_at=2026-07-17T12:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146049020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d33f5c8-0ad0-4338-95d8-0dcf61c95c8e,host='devstack@QuobyteHD#QuobyteHD',id=69c3fd88-1fec-46cb-9309-aa62726e89bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:12Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c6ceeb-79b8-4767-901b-75403e3be309),volume_type_id=54c6ceeb-79b8-4767-901b-75403e3be309)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Creating volume 69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:12 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:12 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf 1073741824 Jul 17 14:17:12 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-bfa51bfa-1579-4ac1-8b39-a79590626786 tempest-ServerActionsTestOtherA-620145997 None] Terminate volume connection completed successfully. Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-bfa51bfa-1579-4ac1-8b39-a79590626786 tempest-ServerActionsTestOtherA-620145997 None] Deleting attachment ee85701b-dbf7-411e-ad7c-ae5a6eb5eacf. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Created reservations ['a258be99-bdec-4287-bf76-667082dbfe58', '54c15c37-198c-47ac-a8cf-9c9b90386b84', '9451da86-7713-41dd-82ce-c2e08bda0fdb', 'ba337976-f215-41f2-9a12-3338540cae54'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:12 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:12 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:13 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.484s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Deleted volume successfully. Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c3453076-3ef5-473b-91f5-a0fffc092084 tempest-VolumesTestJSON-1551210174 None] Lock "cinder-cec9754e-957b-4bef-bd4f-2dd0053826c5-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:13 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf 1073741824" returned: 0 in 0.874s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:13 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf Jul 17 14:17:13 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "cinder-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Acquiring lock "cinder-quobyte-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d253cd-0c84-42a2-9043-f4117b6a11c9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:13 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-8c488f54-8f54-4ce3-8e9d-90d85a54b2a2 tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:13 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:13 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf" returned: 0 in 0.587s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-8c488f54-8f54-4ce3-8e9d-90d85a54b2a2 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.119s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-8c488f54-8f54-4ce3-8e9d-90d85a54b2a2 tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14423ed0-1993-472e-8cfc-30f9d764e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c3fd88-1fec-46cb-9309-aa62726e89bf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad1e9b2-6ff2-448e-a8e3-23b312d950a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:14 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Volume volume-69c3fd88-1fec-46cb-9309-aa62726e89bf (69c3fd88-1fec-46cb-9309-aa62726e89bf): created successfully Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad1e9b2-6ff2-448e-a8e3-23b312d950a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (f4a65f4f-cac8-4f35-80a5-e1379aa4049b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-95c4b2d3-22a5-4ae0-9ea3-a2be94efaee2 tempest-GroupSnapshotsTest-603598133 None] Created volume successfully. Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-8c488f54-8f54-4ce3-8e9d-90d85a54b2a2 tempest-ServerActionsTestOtherA-620145997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbfe4690-cb8c-4e28-9484-aad0400c86ea', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:17:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-2fa6efbf-4c4a-444e-9338-a5a915967ddc req-8c488f54-8f54-4ce3-8e9d-90d85a54b2a2 tempest-ServerActionsTestOtherA-620145997 None] attachment_update completed successfully. Jul 17 14:17:14 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" returned: 0 in 0.491s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:14 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c Jul 17 14:17:14 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:14 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "cinder-quobyte-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c" released by "delete_volume" :: held 0.879s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Created reservations ['7a5e7fc8-4d0a-491c-b748-f5eb42bbeef9', '9ef386d8-cd86-487b-af85-7d9a50a4f3e9', 'c527088f-ef5a-47ca-b084-84eae0ae2fe2', '19393ca1-2a96-48c2-9d99-cacc8119e6fc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:14 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:14 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:15 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Deleted volume successfully. Jul 17 14:17:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-15019bac-2cbf-40d8-8a64-13670ffa2fd1 tempest-GroupSnapshotsTest-603598133 None] Update group completed successfully. Jul 17 14:17:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a6b3094f-51a5-4a73-bc9b-fa42379244ea tempest-VolumesTestJSON-1551210174 None] Lock "cinder-e8e37e2c-7afa-49a0-8777-3317b8bbfa3c-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-80a0eedc-3b7e-4696-8bf8-f9face22605f tempest-GroupSnapshotsTest-603598133 None] Update group completed successfully. Jul 17 14:17:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-04caff22-3e9f-458f-901f-794c1ea082cc tempest-GroupSnapshotsTest-603598133 None] Update group completed successfully. Jul 17 14:17:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5074afb3-561e-4b3e-b7e1-a754055982cc tempest-GroupSnapshotsTest-603598133 None] Update group completed successfully. Jul 17 14:17:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] GroupSnapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: creating. Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Group snapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: creating. {{(pid=87804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Creating offline snapshot 706f9b2d-064e-4c08-8b6a-a7bef211d2cc of volume 673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4eac9-0d17-4bde-acb9-2a861f338762]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:21 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd Jul 17 14:17:21 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:22 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:22 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc 1G Jul 17 14:17:22 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:22 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc 1G" returned: 0 in 0.551s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:22 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc Jul 17 14:17:22 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:23 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:23 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:23 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc Jul 17 14:17:23 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:23 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:23 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info Jul 17 14:17:23 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:23 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info" returned: 0 in 0.319s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:23 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:23 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info Jul 17 14:17:23 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:24 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.info" returned: 0 in 0.326s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Creating offline snapshot af168c5f-d1cd-478b-abd2-002dfcce2c42 of volume 69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa52c7fe-33ac-44ae-9d04-ec354058bdfd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:24 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf Jul 17 14:17:24 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:24 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf" returned: 0 in 0.646s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:24 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 1G Jul 17 14:17:24 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:25 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 1G" returned: 0 in 0.660s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c3fd88-1fec-46cb-9309-aa62726e89bf -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:25 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c3fd88-1fec-46cb-9309-aa62726e89bf -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 Jul 17 14:17:25 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:25 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:25 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:25 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 8 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:17:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:17:26 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c3fd88-1fec-46cb-9309-aa62726e89bf -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42" returned: 0 in 0.481s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:26 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:26 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 Jul 17 14:17:26 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:26 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42" returned: 0 in 0.321s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:26 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info Jul 17 14:17:26 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:26 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:26 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:26 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info Jul 17 14:17:26 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:27 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.info" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:27 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=112,cinder:SELECT=111,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:17:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8f3125de-068a-4cd3-ae20-8e8e3b69a566 tempest-GroupSnapshotsTest-603598133 None] group_snapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: created successfully Jul 17 14:17:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85483020-3976-45db-923b-e36b9eb0cf9c tempest-GroupSnapshotsV319Test-1172610156 None] Group tempest-GroupSnapshotsV319Test-Group-660073157: creating Jul 17 14:17:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85483020-3976-45db-923b-e36b9eb0cf9c tempest-GroupSnapshotsV319Test-1172610156 None] Group tempest-GroupSnapshotsV319Test-Group-660073157: created successfully Jul 17 14:17:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85483020-3976-45db-923b-e36b9eb0cf9c tempest-GroupSnapshotsV319Test-1172610156 None] Create group completed successfully. Jul 17 14:17:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] group_snapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: deleting Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] group_snapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: deleting {{(pid=87804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-706f9b2d-064e-4c08-8b6a-a7bef211d2cc" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-706f9b2d-064e-4c08-8b6a-a7bef211d2cc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Deleting offline snapshot 706f9b2d-064e-4c08-8b6a-a7bef211d2cc of volume 673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] snapshot_file for this snap is: volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d04f4d-0c85-48d4-8cc6-d4338f8a460d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:28 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc Jul 17 14:17:28 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:28 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc" returned: 0 in 0.452s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d2b59-bd49-4172-8ea2-cd718940d9a9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:29 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd Jul 17 14:17:29 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:29 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" returned: 0 in 0.517s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:29 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc Jul 17 14:17:29 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Flow 'volume_create_manager' (bc68e567-055a-49e6-be10-875a912ec132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b354f6cd-eb12-47b0-9a1b-8042b9f7d066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b354f6cd-eb12-47b0-9a1b-8042b9f7d066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847685957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b462721c-fbe9-436e-97cb-edaf2f30278d,host='devstack@QuobyteHD#QuobyteHD',id=a1a0512c-2878-48b1-a9e4-f123cc971f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55edacbda0d04d8ea6f7e3c9a78b87c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:30Z,use_quota=True,user_id='7f4c8fe4411b42eb9fb42c9ecf885e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c47941b-04e8-4e9f-b13d-dfb433597eae),volume_type_id=2c47941b-04e8-4e9f-b13d-dfb433597eae)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7a8f22-3c5b-451b-ac3e-65f4089974e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7a8f22-3c5b-451b-ac3e-65f4089974e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d49767-eefc-46b8-b835-d69bebd7c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d49767-eefc-46b8-b835-d69bebd7c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a0512c-2878-48b1-a9e4-f123cc971f14', 'volume_name': 'volume-a1a0512c-2878-48b1-a9e4-f123cc971f14', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf825f44-9486-4ed4-ac08-96192c0a353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf825f44-9486-4ed4-ac08-96192c0a353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9a2a9e-2f4c-4e89-b83f-8a2febefce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:30 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Volume a1a0512c-2878-48b1-a9e4-f123cc971f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a0512c-2878-48b1-a9e4-f123cc971f14', 'volume_size': 1} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b462721c-fbe9-436e-97cb-edaf2f30278d,created_at=2026-07-17T12:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847685957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b462721c-fbe9-436e-97cb-edaf2f30278d,host='devstack@QuobyteHD#QuobyteHD',id=a1a0512c-2878-48b1-a9e4-f123cc971f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55edacbda0d04d8ea6f7e3c9a78b87c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:30Z,use_quota=True,user_id='7f4c8fe4411b42eb9fb42c9ecf885e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c47941b-04e8-4e9f-b13d-dfb433597eae),volume_type_id=2c47941b-04e8-4e9f-b13d-dfb433597eae)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Creating volume a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:30 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:30 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 1073741824 Jul 17 14:17:30 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:30 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc" returned: 0 in 0.832s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:30 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc Jul 17 14:17:30 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:30 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:30 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd.706f9b2d-064e-4c08-8b6a-a7bef211d2cc" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 1073741824" returned: 0 in 0.643s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-706f9b2d-064e-4c08-8b6a-a7bef211d2cc" released by "_delete_snapshot" :: held 2.339s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" released by "delete_snapshot" :: held 2.401s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-af168c5f-d1cd-478b-abd2-002dfcce2c42" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:30 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 Jul 17 14:17:30 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-af168c5f-d1cd-478b-abd2-002dfcce2c42" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Deleting offline snapshot af168c5f-d1cd-478b-abd2-002dfcce2c42 of volume 69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:17:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] snapshot_file for this snap is: volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8c8b3-dd03-4f18-9881-be84c7704d02]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:31 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 Jul 17 14:17:31 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:31 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14" returned: 0 in 0.442s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9a2a9e-2f4c-4e89-b83f-8a2febefce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a0512c-2878-48b1-a9e4-f123cc971f14', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d9b4aa-88a8-46ad-8ae0-6b2d5419f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Volume volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 (a1a0512c-2878-48b1-a9e4-f123cc971f14): created successfully Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d9b4aa-88a8-46ad-8ae0-6b2d5419f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Flow 'volume_create_manager' (bc68e567-055a-49e6-be10-875a912ec132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e290a713-27ce-42ae-8162-2a59781eb90b tempest-GroupSnapshotsV319Test-1172610156 None] Created volume successfully. Jul 17 14:17:31 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42" returned: 0 in 0.531s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69c3fd88-1fec-46cb-9309-aa62726e89bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f9d02-0612-42c6-9146-6ada854216b6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:31 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf Jul 17 14:17:31 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:32 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf" returned: 0 in 0.459s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:32 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 Jul 17 14:17:32 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:32 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:32 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42 Jul 17 14:17:32 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:32 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf.af168c5f-d1cd-478b-abd2-002dfcce2c42" returned: 0 in 0.275s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-af168c5f-d1cd-478b-abd2-002dfcce2c42" released by "_delete_snapshot" :: held 1.717s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" released by "delete_snapshot" :: held 1.755s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:32 devstack cinder-volume[87804]: WARNING cinder.quota [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-463973492 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-463973492, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:32 devstack cinder-volume[87804]: WARNING cinder.quota [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-463973492 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-463973492, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:34 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Created reservations ['c82d54e6-04ec-410c-b2e9-7187816fbbb7', 'ea2314d6-c7f5-4539-b3d0-c582e44a6ece', 'e0d74936-96a3-40c3-b76c-c6d3c87bae8b', 'b8cd0348-d45b-47cc-9b29-7cdab0223eb1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:38 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] Created reservations ['1c7627a8-3128-4dec-a989-a1522a1f7105', '3c08577b-a781-4aa8-b6b3-3e2e9923e034', 'eb17e52a-f607-4b9d-ab2a-cc796650df2f', 'af83e29e-62ae-4610-9e26-95051d499771'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] GroupSnapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: creating. Jul 17 14:17:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a04d4bcd-d190-45bc-96b8-fa133ec28d4c tempest-GroupSnapshotsTest-603598133 None] group_snapshot 88381908-bfc2-4bb3-80f5-667d5b43de8d: deleted successfully Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Group snapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: creating. {{(pid=87804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Creating offline snapshot ac5029c9-ea7a-4575-b922-e85a5dadc755 of volume a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2638b-ed7c-4564-a3de-d1839f3ba699]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:39 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 Jul 17 14:17:39 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:39 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:39 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 1G Jul 17 14:17:39 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db570ba-078b-4b06-b017-c771714aa5b2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:39 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd Jul 17 14:17:39 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 1G" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 Jul 17 14:17:40 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" returned: 0 in 0.397s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd Jul 17 14:17:40 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 Jul 17 14:17:40 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-673e1fd1-d7e7-49d9-a94b-cdbbaad4b6fd" released by "delete_volume" :: held 0.731s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[033493e7-f14d-4be7-a94c-017333f51c01]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf Jul 17 14:17:40 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info Jul 17 14:17:40 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:40 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf" returned: 0 in 0.393s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:40 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:40 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:40 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:41 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info Jul 17 14:17:41 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:41 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-69c3fd88-1fec-46cb-9309-aa62726e89bf" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:41 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.info" returned: 0 in 0.305s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-69c3fd88-1fec-46cb-9309-aa62726e89bf" released by "delete_volume" :: held 0.790s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Created reservations ['206ab143-5c83-43f3-bc4b-29af012f95d2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5acbc397-6516-4a8f-ba3f-8a65eba969bb tempest-GroupSnapshotsV319Test-1172610156 None] group_snapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: created successfully Jul 17 14:17:41 devstack cinder-volume[87804]: WARNING cinder.quota [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-463973492 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-463973492, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Created reservations ['174f0775-fee1-4cb6-ad57-dfe52cf5d58d', '640322f1-e90a-4aa5-9a32-f178d6e3c3d6', '42e0821f-8f9c-47ae-ac82-a3dece72dd3e', '6495eec0-926b-4d25-a7f3-64cdbef5de95'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Created reservations ['c24c451b-3fb4-4b14-ac85-9974ea37f509', '6bdcc632-62e5-40b0-aea7-3c6b96e7f07b', 'c6382f81-3c9d-4a2b-9ad1-3f3d6df3d02b', '9446250d-61cb-4383-9306-888044043f53'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:41 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:41 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:41 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:41 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f2abb2a2-6f63-4f43-aaec-2d1658af65fb tempest-GroupSnapshotsTest-603598133 None] Delete group completed successfully. Jul 17 14:17:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b7d14e3f-f9f0-4f65-a155-e883963559ae tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-53037006: creating Jul 17 14:17:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b7d14e3f-f9f0-4f65-a155-e883963559ae tempest-GroupSnapshotsTest-603598133 None] Group tempest-GroupSnapshotsTest-Group-53037006: created successfully Jul 17 14:17:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b7d14e3f-f9f0-4f65-a155-e883963559ae tempest-GroupSnapshotsTest-603598133 None] Create group completed successfully. Jul 17 14:17:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] group_snapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: deleting Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] group_snapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: deleting {{(pid=87804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "cinder-quobyte-ac5029c9-ea7a-4575-b922-e85a5dadc755" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-ac5029c9-ea7a-4575-b922-e85a5dadc755" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Deleting offline snapshot ac5029c9-ea7a-4575-b922-e85a5dadc755 of volume a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] snapshot_file for this snap is: volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e205a5-2776-4931-b336-18d0cfb59214]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:42 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 Jul 17 14:17:42 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:43 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a0512c-2878-48b1-a9e4-f123cc971f14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a7890-5726-4c7a-9e0b-2b42ba1359e3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:43 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 Jul 17 14:17:43 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:43 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:43 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 Jul 17 14:17:43 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:43 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755" returned: 0 in 0.378s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:44 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755 Jul 17 14:17:44 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (6b65d8e1-76d0-4efc-aa0a-fab50816e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cb930e-4923-4c79-9b6b-1b283ad25a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:44 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14.ac5029c9-ea7a-4575-b922-e85a5dadc755" returned: 0 in 0.304s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cb930e-4923-4c79-9b6b-1b283ad25a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883502262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a3d7a92-b333-4221-b87d-735a86f43074,host='devstack@QuobyteHD#QuobyteHD',id=31290986-7f57-4bb6-9652-d60f86ffe3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:44Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ff796f4-6f44-44a0-b283-4302b39c29c4),volume_type_id=4ff796f4-6f44-44a0-b283-4302b39c29c4)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ca1061-8c23-4996-ac2b-e51a40b5a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ca1061-8c23-4996-ac2b-e51a40b5a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7235ee9c-1358-471d-8a9c-60cc7e1b3c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7235ee9c-1358-471d-8a9c-60cc7e1b3c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31290986-7f57-4bb6-9652-d60f86ffe3e2', 'volume_name': 'volume-31290986-7f57-4bb6-9652-d60f86ffe3e2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac72b007-060f-4619-81d0-e02d42200c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac72b007-060f-4619-81d0-e02d42200c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6de606-0eba-40df-904b-b497ee7d5157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Volume 31290986-7f57-4bb6-9652-d60f86ffe3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31290986-7f57-4bb6-9652-d60f86ffe3e2', 'volume_size': 1} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a3d7a92-b333-4221-b87d-735a86f43074,created_at=2026-07-17T12:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883502262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a3d7a92-b333-4221-b87d-735a86f43074,host='devstack@QuobyteHD#QuobyteHD',id=31290986-7f57-4bb6-9652-d60f86ffe3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='090e8f804a0d4bf3b4e8310f8571c458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:17:44Z,use_quota=True,user_id='035559d83fcb4eaeb6de2cc84628f170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ff796f4-6f44-44a0-b283-4302b39c29c4),volume_type_id=4ff796f4-6f44-44a0-b283-4302b39c29c4)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Creating volume 31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:17:44 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-ac5029c9-ea7a-4575-b922-e85a5dadc755" released by "_delete_snapshot" :: held 1.585s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" released by "delete_snapshot" :: held 1.611s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:44 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 1073741824 Jul 17 14:17:44 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:44 devstack cinder-volume[87804]: WARNING cinder.quota [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-539711081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-539711081, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:44 devstack cinder-volume[87804]: WARNING cinder.quota [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-539711081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-539711081, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] Created reservations ['16736802-eb31-4910-ba97-401fe7322a13', 'cbfd5561-64f9-4ec9-a743-f7ac5aa8f603', '34166101-8b90-49e1-a641-89e4734391af', 'a957bfed-2b55-4054-afa3-5333629538cd'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-88ed41ba-e663-4ba0-bdb8-1680c87c8104 tempest-GroupSnapshotsV319Test-1172610156 None] group_snapshot 76234e05-3e30-4fc0-976e-8bdff5c50426: deleted successfully Jul 17 14:17:44 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 1073741824" returned: 0 in 0.458s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:44 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 Jul 17 14:17:44 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:45 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2" returned: 0 in 0.274s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6de606-0eba-40df-904b-b497ee7d5157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31290986-7f57-4bb6-9652-d60f86ffe3e2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721ca026-c307-4b24-b25f-4cc8d96679a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:17:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Volume volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 (31290986-7f57-4bb6-9652-d60f86ffe3e2): created successfully Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721ca026-c307-4b24-b25f-4cc8d96679a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Flow 'volume_create_manager' (6b65d8e1-76d0-4efc-aa0a-fab50816e16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:17:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-88998bc0-b6a7-40ea-8a86-0498a624d204 tempest-GroupSnapshotsTest-603598133 None] Created volume successfully. Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641c832-8dc3-4aa6-a661-14120f761fa2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:45 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 Jul 17 14:17:45 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] GroupSnapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: creating. Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Group snapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: creating. {{(pid=87804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Creating offline snapshot d7196a74-b543-44cf-8124-3b5cfd7024cf of volume 31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:17:45 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1baeed8-4297-4051-900b-cf9308e31615]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:45 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14 Jul 17 14:17:45 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:46 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 Jul 17 14:17:46 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:46 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a1a0512c-2878-48b1-a9e4-f123cc971f14" returned: 0 in 0.334s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "cinder-quobyte-a1a0512c-2878-48b1-a9e4-f123cc971f14" released by "delete_volume" :: held 0.837s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Created reservations ['cadd8ef3-d841-4e5e-9a4c-f846d9244bd3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:46 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:46 devstack cinder-volume[87804]: WARNING cinder.quota [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-539711081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-539711081, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:46 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf 1G Jul 17 14:17:46 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Created reservations ['3806d9d9-0254-4690-8da1-5ea75cc4c8cb', '1f179a2f-a767-4874-b885-59794b58a44d', '8f9fb218-c953-470e-8ace-2d93db06cfa5', '55ae4a56-dc54-47af-95c5-61510a134b0b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:46 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:46 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:46 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ad98a728-79ce-4a67-a4d9-1b8ebfb74f29 tempest-GroupSnapshotsV319Test-1172610156 None] Delete group completed successfully. Jul 17 14:17:46 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf 1G" returned: 0 in 0.632s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:47 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf Jul 17 14:17:47 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:47 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:47 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:47 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf Jul 17 14:17:47 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:47 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:47 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info Jul 17 14:17:47 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:48 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info" returned: 0 in 0.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:48 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:17:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:48 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info Jul 17 14:17:48 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:48 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.info" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a10611a6-94f8-4a4a-8387-dcf78041a750 tempest-GroupSnapshotsTest-603598133 None] group_snapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: created successfully Jul 17 14:17:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] group_snapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: deleting Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] group_snapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: deleting {{(pid=87804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-d7196a74-b543-44cf-8124-3b5cfd7024cf" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-d7196a74-b543-44cf-8124-3b5cfd7024cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Deleting offline snapshot d7196a74-b543-44cf-8124-3b5cfd7024cf of volume 31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] snapshot_file for this snap is: volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b064b6-93a6-4f67-901f-2fb7972d214f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:49 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf Jul 17 14:17:49 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:49 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf" returned: 0 in 0.440s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31290986-7f57-4bb6-9652-d60f86ffe3e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc55d0a-3454-4fef-a1a4-f5e48f88ba11]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:50 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 Jul 17 14:17:50 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:50 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2" returned: 0 in 0.459s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:50 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf Jul 17 14:17:50 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:50 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf" returned: 0 in 0.426s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:50 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf Jul 17 14:17:50 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:51 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2.d7196a74-b543-44cf-8124-3b5cfd7024cf" returned: 0 in 0.316s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-d7196a74-b543-44cf-8124-3b5cfd7024cf" released by "_delete_snapshot" :: held 1.776s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" released by "delete_snapshot" :: held 1.803s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:51 devstack cinder-volume[87804]: WARNING cinder.quota [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260919145 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260919145, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:51 devstack cinder-volume[87804]: WARNING cinder.quota [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260919145 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260919145, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:51 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] Created reservations ['3252750d-9bed-44f7-b459-a1063c702a52', '33297526-2bd7-465b-98cf-2df94121965a', 'dbde1256-cb8e-46e7-9c38-750c3c33a19a', 'b91f9937-291e-493c-8885-db3048283cf2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8086f920-91a1-4db3-aec7-24461d486b21 tempest-GroupSnapshotsTest-603598133 None] group_snapshot 2271f18e-5d59-466b-a28d-1840c6a0f099: deleted successfully Jul 17 14:17:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d60e749-ebc2-48a9-a277-9d731daf5516]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:52 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 Jul 17 14:17:52 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:52 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:52 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2 Jul 17 14:17:52 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:52 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-31290986-7f57-4bb6-9652-d60f86ffe3e2" returned: 0 in 0.300s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Lock "cinder-quobyte-31290986-7f57-4bb6-9652-d60f86ffe3e2" released by "delete_volume" :: held 0.788s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Created reservations ['ca1b6b92-28e5-45b4-bce9-6309b562adb6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:52 devstack cinder-volume[87804]: WARNING cinder.quota [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260919145 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260919145, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:17:52 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Created reservations ['a8d4a3af-6f67-490d-8c39-507ea70d2ed7', 'db3db58a-3df0-4b29-a502-7de02a28f956', '2273a510-a930-498b-9cb1-e06141d03fef', 'f051d8b1-a6c3-417e-bc3c-ee06a6034eb6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:17:53 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:17:53 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:17:53 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:17:53 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:17:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a8eea488-7297-4388-b87b-fe41437e6bfb tempest-GroupSnapshotsTest-603598133 None] Delete group completed successfully. Jul 17 14:17:58 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=155,cinder:UPDATE=165,cinder:INSERT=36,cinder:DELETE=4 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:17:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-13fee6fd-2649-48d8-afda-c4d669f68621 req-0c3acb20-84fd-46b1-8309-ee9c5403c5ce tempest-ServerActionsTestOtherA-620145997 None] Terminate volume connection completed successfully. Jul 17 14:17:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-13fee6fd-2649-48d8-afda-c4d669f68621 req-0c3acb20-84fd-46b1-8309-ee9c5403c5ce tempest-ServerActionsTestOtherA-620145997 None] Deleting attachment cbfe4690-cb8c-4e28-9484-aad0400c86ea. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:18:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9f3cca70-a0b4-4393-af6f-a5828b693ea3 tempest-GroupsTest-1989894092 None] Group tempest-Group1-2045547714: creating Jul 17 14:18:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9f3cca70-a0b4-4393-af6f-a5828b693ea3 tempest-GroupsTest-1989894092 None] Group tempest-Group1-2045547714: created successfully Jul 17 14:18:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9f3cca70-a0b4-4393-af6f-a5828b693ea3 tempest-GroupsTest-1989894092 None] Create group completed successfully. Jul 17 14:18:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85ada928-e62e-4ea2-984b-720176a9bd5c tempest-GroupsTest-1989894092 None] Group tempest-Group2-2060684128: creating Jul 17 14:18:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85ada928-e62e-4ea2-984b-720176a9bd5c tempest-GroupsTest-1989894092 None] Group tempest-Group2-2060684128: created successfully Jul 17 14:18:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-85ada928-e62e-4ea2-984b-720176a9bd5c tempest-GroupsTest-1989894092 None] Create group completed successfully. Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Acquiring lock "cinder-aebf7534-b766-4c50-97fa-bd35dc0c95af-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "cinder-aebf7534-b766-4c50-97fa-bd35dc0c95af-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Acquiring lock "cinder-quobyte-aebf7534-b766-4c50-97fa-bd35dc0c95af" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "cinder-quobyte-aebf7534-b766-4c50-97fa-bd35dc0c95af" acquired by "delete_volume" :: waited 0.037s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[690fc7f7-9194-43fd-8a97-be585f143e1e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:03 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af Jul 17 14:18:03 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:18:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (7ed26234-b450-4ab2-9e7a-a5c8eec76e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb6734d-191a-48c5-b4d7-a3178dee5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb6734d-191a-48c5-b4d7-a3178dee5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595209796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06a9ce12-8973-4ab0-950b-56f64bd4f322,host='devstack@QuobyteHD#QuobyteHD',id=ed6ab1df-7413-4eab-89f2-da1c9add0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:04Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58232e71-75ef-486b-9539-2558a3418119),volume_type_id=58232e71-75ef-486b-9539-2558a3418119)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa977f6-6473-43f0-b465-a4faab0feaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa977f6-6473-43f0-b465-a4faab0feaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:04 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6e2507-eb85-43a9-8c61-b1df1759f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6e2507-eb85-43a9-8c61-b1df1759f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6ab1df-7413-4eab-89f2-da1c9add0d32', 'volume_name': 'volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6027c8d-2675-4c59-85a8-c09555c94063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6027c8d-2675-4c59-85a8-c09555c94063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5324fdb4-738a-43e6-a9d6-bebc40268751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Volume ed6ab1df-7413-4eab-89f2-da1c9add0d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32', 'volume_size': 1} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06a9ce12-8973-4ab0-950b-56f64bd4f322,created_at=2026-07-17T12:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595209796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06a9ce12-8973-4ab0-950b-56f64bd4f322,host='devstack@QuobyteHD#QuobyteHD',id=ed6ab1df-7413-4eab-89f2-da1c9add0d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:04Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58232e71-75ef-486b-9539-2558a3418119),volume_type_id=58232e71-75ef-486b-9539-2558a3418119)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Creating volume ed6ab1df-7413-4eab-89f2-da1c9add0d32 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:18:04 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af" returned: 0 in 0.844s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:04 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 1073741824 Jul 17 14:18:04 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:04 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af Jul 17 14:18:04 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:04 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aebf7534-b766-4c50-97fa-bd35dc0c95af" returned: 0 in 0.380s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "cinder-quobyte-aebf7534-b766-4c50-97fa-bd35dc0c95af" released by "delete_volume" :: held 1.319s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Created reservations ['7e5fea10-d204-48c0-93ac-5816bb251958', '967afbee-615b-4f99-b3be-5973767c0369', '0dfa4ccd-67bc-4e67-93d2-eb55c45de12f', 'ad930112-484e-45b8-a1e6-f3458994f3b4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:04 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:04 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:04 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 1073741824" returned: 0 in 0.742s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:04 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 Jul 17 14:18:04 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "cinder-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "cinder-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:05 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.424s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "cinder-quobyte-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Deleted volume successfully. Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "cinder-quobyte-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" acquired by "delete_volume" :: waited 0.047s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a9473972-d422-4c0d-90cf-6da606a69c68 tempest-AttachVolumeShelveTestJSON-730019975 None] Lock "cinder-aebf7534-b766-4c50-97fa-bd35dc0c95af-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:05 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32" returned: 0 in 0.390s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf66a6-5cc5-483e-bb70-89489d2c48e9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5324fdb4-738a-43e6-a9d6-bebc40268751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb57c6dc-9130-4abc-b210-13a81fbb5679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:05 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Volume volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 (ed6ab1df-7413-4eab-89f2-da1c9add0d32): created successfully Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb57c6dc-9130-4abc-b210-13a81fbb5679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (7ed26234-b450-4ab2-9e7a-a5c8eec76e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-55f4d20c-f49e-4fbf-ab60-7ef5911131b5 tempest-GroupsTest-1989894092 None] Created volume successfully. Jul 17 14:18:05 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba Jul 17 14:18:05 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:05 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" returned: 0 in 0.456s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:05 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba Jul 17 14:18:05 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:06 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "cinder-quobyte-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba" released by "delete_volume" :: held 0.834s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Created reservations ['7ba40528-09b6-4c34-92fb-2089d1dfb343', '75f489b3-5390-40c8-9b7f-d1675c70438a', 'c920593c-da25-437e-a06b-af048cd26540', '2efa629a-54d5-4db8-b6f1-e1f52dd8c8c8'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:06 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:06 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:06 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.461s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Deleted volume successfully. Jul 17 14:18:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad7095ab-37eb-496e-aa9a-f79027fc7a9c tempest-ServerActionsTestOtherA-620145997 None] Lock "cinder-14e57cf8-03fa-4f4c-b4d7-922f0494a9ba-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Acquiring lock "cinder-quobyte-ed6ab1df-7413-4eab-89f2-da1c9add0d32" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-ed6ab1df-7413-4eab-89f2-da1c9add0d32" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:07 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c5cbd-5166-4b6d-a55a-0f758b41cd6b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:08 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 Jul 17 14:18:08 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:08 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32" returned: 0 in 0.561s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:08 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32 Jul 17 14:18:08 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-519ec490-3e62-4be7-985c-9a95fbb35f50 tempest-GroupsV314Test-2084765125 None] Group tempest-GroupsV314Test-Group-1305914123: creating Jul 17 14:18:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-519ec490-3e62-4be7-985c-9a95fbb35f50 tempest-GroupsV314Test-2084765125 None] Group tempest-GroupsV314Test-Group-1305914123: created successfully Jul 17 14:18:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-519ec490-3e62-4be7-985c-9a95fbb35f50 tempest-GroupsV314Test-2084765125 None] Create group completed successfully. Jul 17 14:18:08 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ed6ab1df-7413-4eab-89f2-da1c9add0d32" returned: 0 in 0.327s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-ed6ab1df-7413-4eab-89f2-da1c9add0d32" released by "delete_volume" :: held 0.983s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:08 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Created reservations ['7351a806-6ac5-43de-8665-9bccd495acbd'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:08 devstack cinder-volume[87804]: WARNING cinder.quota [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1244297085 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1244297085, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:08 devstack cinder-volume[87804]: WARNING cinder.quota [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1244297085 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1244297085, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Created reservations ['921f0915-e737-4f3e-9843-dba6758a2eba', 'c9ee669b-cb18-4041-889d-49c13f94597d', '3e6173a2-4646-4e61-aa8a-ffe707b27e10', '29ded118-47d7-4beb-844a-02c886ed23a3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:09 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:09 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Created reservations ['a1d07dd1-25ad-4e54-9423-37a645d71d2a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:09 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:09 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1e36b09b-5209-45bf-a479-c6adb3a0f17c tempest-GroupsTest-1989894092 None] Delete group completed successfully. Jul 17 14:18:09 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:09 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.489s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:10 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-97ad21d4-7115-4688-b487-f977e34cf3e6 tempest-GroupsTest-1989894092 None] Delete group completed successfully. Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Flow 'volume_create_manager' (c16ae5ad-22dc-459a-811b-3a7ce651e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5cbeb-934c-4bc1-9ba3-63030dfb02d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b5cbeb-934c-4bc1-9ba3-63030dfb02d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1673510979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b58d63f-da75-4908-a636-b608e419d65c,host='devstack@QuobyteHD#QuobyteHD',id=c150ebe5-9677-4b24-a621-7943957b921f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1950b5ba0a4ec0b13b77bca0a8f25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:10Z,use_quota=True,user_id='97ff190955f44302ab335e0f81d2c93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0224341-e0cf-40f7-9108-09beee8765a2),volume_type_id=e0224341-e0cf-40f7-9108-09beee8765a2)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2a5a3b-0352-4a03-9fbd-af391de41fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2a5a3b-0352-4a03-9fbd-af391de41fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e8d8bb-d840-43e0-b784-56e39d587613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e8d8bb-d840-43e0-b784-56e39d587613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c150ebe5-9677-4b24-a621-7943957b921f', 'volume_name': 'volume-c150ebe5-9677-4b24-a621-7943957b921f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a427f71-3ecd-4e49-bd47-fc0e07ef41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a427f71-3ecd-4e49-bd47-fc0e07ef41bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23268770-28c1-4b54-bd1b-366f4f6445bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:10 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Volume c150ebe5-9677-4b24-a621-7943957b921f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c150ebe5-9677-4b24-a621-7943957b921f', 'volume_size': 1} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b58d63f-da75-4908-a636-b608e419d65c,created_at=2026-07-17T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1673510979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b58d63f-da75-4908-a636-b608e419d65c,host='devstack@QuobyteHD#QuobyteHD',id=c150ebe5-9677-4b24-a621-7943957b921f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1950b5ba0a4ec0b13b77bca0a8f25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:10Z,use_quota=True,user_id='97ff190955f44302ab335e0f81d2c93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0224341-e0cf-40f7-9108-09beee8765a2),volume_type_id=e0224341-e0cf-40f7-9108-09beee8765a2)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Creating volume c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:18:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:18:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:10 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f 1073741824 Jul 17 14:18:10 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cfc9df79-b09d-4749-b558-a6a3c358ad5f tempest-GroupsTest-1989894092 None] Group tempest-GroupsTest-Group-169426528: creating Jul 17 14:18:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cfc9df79-b09d-4749-b558-a6a3c358ad5f tempest-GroupsTest-1989894092 None] Group tempest-GroupsTest-Group-169426528: created successfully Jul 17 14:18:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cfc9df79-b09d-4749-b558-a6a3c358ad5f tempest-GroupsTest-1989894092 None] Create group completed successfully. Jul 17 14:18:11 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f 1073741824" returned: 0 in 0.861s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:11 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:11 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:12 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.358s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23268770-28c1-4b54-bd1b-366f4f6445bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c150ebe5-9677-4b24-a621-7943957b921f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff4942f-699d-40ac-918c-56c3a91f5fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Volume volume-c150ebe5-9677-4b24-a621-7943957b921f (c150ebe5-9677-4b24-a621-7943957b921f): created successfully Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff4942f-699d-40ac-918c-56c3a91f5fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Flow 'volume_create_manager' (c16ae5ad-22dc-459a-811b-3a7ce651e580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4cd3dd19-badd-4d54-ab40-c6eb5621f0a8 tempest-GroupsV314Test-2084765125 None] Created volume successfully. Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (16666aa8-cd04-40f1-b68d-30f77ea09b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc3db87-2d8a-40e7-a357-695072cf62f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc3db87-2d8a-40e7-a357-695072cf62f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152733867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,host='devstack@QuobyteHD#QuobyteHD',id=fc114c30-4c52-416a-bfd3-3def42ee7c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:13Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0becbe3-28a2-4cb4-bcd5-51134402da16),volume_type_id=a0becbe3-28a2-4cb4-bcd5-51134402da16)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae993798-c6c9-49e5-8638-e54374fdd2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae993798-c6c9-49e5-8638-e54374fdd2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354719d4-6ab4-4ae9-9eda-644276c9239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354719d4-6ab4-4ae9-9eda-644276c9239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc114c30-4c52-416a-bfd3-3def42ee7c84', 'volume_name': 'volume-fc114c30-4c52-416a-bfd3-3def42ee7c84', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cac7c3-0363-4a27-9c5d-b8a3ecaa4370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cac7c3-0363-4a27-9c5d-b8a3ecaa4370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410cf4d9-d88b-48d9-80d6-fb09894a8411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Volume fc114c30-4c52-416a-bfd3-3def42ee7c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc114c30-4c52-416a-bfd3-3def42ee7c84', 'volume_size': 1} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,created_at=2026-07-17T12:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152733867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,host='devstack@QuobyteHD#QuobyteHD',id=fc114c30-4c52-416a-bfd3-3def42ee7c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:13Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0becbe3-28a2-4cb4-bcd5-51134402da16),volume_type_id=a0becbe3-28a2-4cb4-bcd5-51134402da16)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Creating volume fc114c30-4c52-416a-bfd3-3def42ee7c84 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:18:13 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:18:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:13 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 1073741824 Jul 17 14:18:13 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:14 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 1073741824" returned: 0 in 0.585s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:14 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 Jul 17 14:18:14 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:14 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84" returned: 0 in 0.324s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.459s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:14 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Cloning volume c150ebe5-9677-4b24-a621-7943957b921f to volume 67d15cf8-3712-4f6c-a030-781229ce42f0 Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410cf4d9-d88b-48d9-80d6-fb09894a8411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc114c30-4c52-416a-bfd3-3def42ee7c84', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d49753a-70fd-434b-8782-ece382615af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:14 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Volume volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 (fc114c30-4c52-416a-bfd3-3def42ee7c84): created successfully Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d49753a-70fd-434b-8782-ece382615af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (16666aa8-cd04-40f1-b68d-30f77ea09b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Creating offline snapshot ea8f0697-3630-44f2-b812-761a94ee33e7 of volume c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:18:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e4965a99-5950-4414-989a-827714ec6cb9 tempest-GroupsTest-1989894092 None] Created volume successfully. Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76eccb-db83-4b22-aa1e-dbd3d5059688]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:14 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:14 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:15 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.501s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:15 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 1G Jul 17 14:18:15 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:15 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 1G" returned: 0 in 0.545s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c150ebe5-9677-4b24-a621-7943957b921f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:15 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c150ebe5-9677-4b24-a621-7943957b921f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:15 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:16 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c150ebe5-9677-4b24-a621-7943957b921f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.469s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:16 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:16 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:16 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:16 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:16 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info Jul 17 14:18:16 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (4b28e9c6-2375-46af-ba08-3793c0e2ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fba43e-f4c0-4c5f-9488-2b3bce641ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fba43e-f4c0-4c5f-9488-2b3bce641ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34959368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,host='devstack@QuobyteHD#QuobyteHD',id=14a3709d-3542-4d6d-8dfd-e996d09483aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:17Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0becbe3-28a2-4cb4-bcd5-51134402da16),volume_type_id=a0becbe3-28a2-4cb4-bcd5-51134402da16)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2527aad1-18da-44e6-ada6-348135d96613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2527aad1-18da-44e6-ada6-348135d96613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade87b5-35d7-49b4-b22b-e1a9d54b3506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade87b5-35d7-49b4-b22b-e1a9d54b3506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a3709d-3542-4d6d-8dfd-e996d09483aa', 'volume_name': 'volume-14a3709d-3542-4d6d-8dfd-e996d09483aa', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19055737-028f-46cf-bb43-d59d523a2624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19055737-028f-46cf-bb43-d59d523a2624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741163b5-2572-4136-8761-7b348f1eecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Volume 14a3709d-3542-4d6d-8dfd-e996d09483aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a3709d-3542-4d6d-8dfd-e996d09483aa', 'volume_size': 1} Jul 17 14:18:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:17 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info" returned: 0 in 0.520s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:17 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:17 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info Jul 17 14:18:17 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:17 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.info" returned: 0 in 0.289s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] snapshot: ea8f0697-3630-44f2-b812-761a94ee33e7, volume: 67d15cf8-3712-4f6c-a030-781229ce42f0, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d807aee-d98c-49ca-982b-ac313f4882bd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:17 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:17 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:17 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.459s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c150ebe5-9677-4b24-a621-7943957b921f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2185320-b2e7-413c-b143-365a89965b4e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:18 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:18 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:18 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.628s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:18 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:18:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:18 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 Jul 17 14:18:18 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:25 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0" returned: 0 in 6.423s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb947011-a1f0-453d-a680-484dc0f754c0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:25 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:25 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:25 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:25 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:25 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.769s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:18:25 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Converted 1024.00 MB image at 159.39 MB/s Jul 17 14:18:25 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 14:18:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:25 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 Jul 17 14:18:25 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:26 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.360s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 8 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:18:26 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" released by "_copy_volume_from_snapshot" :: held 8.744s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Acquiring lock "cinder-quobyte-ea8f0697-3630-44f2-b812-761a94ee33e7" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-ea8f0697-3630-44f2-b812-761a94ee33e7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Deleting offline snapshot ea8f0697-3630-44f2-b812-761a94ee33e7 of volume c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] snapshot_file for this snap is: volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e23ef7-9894-4db0-a274-3767ea1d8c24]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:26 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:26 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:26 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c150ebe5-9677-4b24-a621-7943957b921f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323baa3-1040-4b11-8ef0-1364acbc1cd2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:26 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=43,cinder:SELECT=47,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:18:26 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:26 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:27 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.555s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:27 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:27 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:27 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.544s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:27 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7 Jul 17 14:18:27 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:28 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f.ea8f0697-3630-44f2-b812-761a94ee33e7" returned: 0 in 0.413s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-ea8f0697-3630-44f2-b812-761a94ee33e7" released by "_delete_snapshot" :: held 2.150s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=116,cinder:UPDATE=113,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.944s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.437s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,created_at=2026-07-17T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34959368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8932ad9-f787-466a-8f24-1e16f4d1a61f,host='devstack@QuobyteHD#QuobyteHD',id=14a3709d-3542-4d6d-8dfd-e996d09483aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4082cfb64149cc863f841e6d5fb8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:17Z,use_quota=True,user_id='974463b652784601928cabf1193b19be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0becbe3-28a2-4cb4-bcd5-51134402da16),volume_type_id=a0becbe3-28a2-4cb4-bcd5-51134402da16)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Creating volume 14a3709d-3542-4d6d-8dfd-e996d09483aa {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:18:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:18:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:28 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa 1073741824 Jul 17 14:18:28 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-854afb84-bca6-4f86-8643-e53abcfe85e8 tempest-GroupsV314Test-2084765125 None] Create group from source-group-8b58d63f-da75-4908-a636-b608e419d65c completed successfully. Jul 17 14:18:29 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa 1073741824" returned: 0 in 0.688s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:29 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa Jul 17 14:18:29 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:29 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741163b5-2572-4136-8761-7b348f1eecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a3709d-3542-4d6d-8dfd-e996d09483aa', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988c4250-f706-4202-b079-3e9f8db240e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Volume volume-14a3709d-3542-4d6d-8dfd-e996d09483aa (14a3709d-3542-4d6d-8dfd-e996d09483aa): created successfully Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988c4250-f706-4202-b079-3e9f8db240e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Flow 'volume_create_manager' (4b28e9c6-2375-46af-ba08-3793c0e2ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-03f2398e-c0fe-45b4-88a7-5a87aa6d520f tempest-GroupsTest-1989894092 None] Created volume successfully. Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Acquiring lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" acquired by "delete_volume" :: waited 0.038s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0dbf1-a925-4145-97c8-ee3586d0b180]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:30 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 Jul 17 14:18:30 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-31d59752-0b0d-47c2-bbee-0e34c8251935 tempest-GroupsTest-1989894092 None] Update group completed successfully. Jul 17 14:18:30 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0" returned: 0 in 0.604s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:30 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0 Jul 17 14:18:30 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:31 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-67d15cf8-3712-4f6c-a030-781229ce42f0" returned: 0 in 0.336s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-67d15cf8-3712-4f6c-a030-781229ce42f0" released by "delete_volume" :: held 1.049s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Created reservations ['1c5544c2-4612-408a-8614-2f5329dc08f5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:31 devstack cinder-volume[87804]: WARNING cinder.quota [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-726245222 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-726245222, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:31 devstack cinder-volume[87804]: WARNING cinder.quota [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-726245222 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-726245222, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Created reservations ['12a3f7a5-48b9-44ad-959f-591a6ad30442', '41991ed0-d07e-4397-822a-7db48df17886', 'a45b516e-1123-499c-8bd6-78e383c3339f', '107ddf15-79ef-4101-aa33-af845a42d786'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:31 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:31 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Acquiring lock "cinder-quobyte-c150ebe5-9677-4b24-a621-7943957b921f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:32 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-c150ebe5-9677-4b24-a621-7943957b921f" acquired by "delete_volume" :: waited 0.047s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-25219b05-4974-41e9-b3d1-6f7b44771a52 tempest-GroupsTest-1989894092 None] Update group completed successfully. Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.696s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c10daa1-57e9-4d50-9ba9-c758e253764a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c9de6c41-acc8-486c-b83c-09de2772077b tempest-GroupsV314Test-2084765125 None] Delete group completed successfully. Jul 17 14:18:32 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:32 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:32 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.436s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:32 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f Jul 17 14:18:32 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:33 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c150ebe5-9677-4b24-a621-7943957b921f" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Lock "cinder-quobyte-c150ebe5-9677-4b24-a621-7943957b921f" released by "delete_volume" :: held 0.881s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Created reservations ['2e2e2473-cfa1-4bcb-8661-4ec260086373'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Created reservations ['306d6a2b-5e23-4d27-9178-885dc35e4872', 'f5a27a82-8310-4426-ab26-cefa418a2123', 'b240cfe4-0250-4de9-b34b-0b195f684f61', '49e3d2f4-5cf3-48ef-9ae8-f28217aab0d3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:33 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:33 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:34 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.358s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8c1d19f6-f47d-44f8-b6df-3b0538b32789 tempest-GroupsV314Test-2084765125 None] Delete group completed successfully. Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Acquiring lock "cinder-quobyte-14a3709d-3542-4d6d-8dfd-e996d09483aa" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-14a3709d-3542-4d6d-8dfd-e996d09483aa" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[be46924c-e226-4795-998d-fd78cc14b728]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:34 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa Jul 17 14:18:34 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:34 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa" returned: 0 in 0.555s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:34 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa Jul 17 14:18:34 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:35 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-14a3709d-3542-4d6d-8dfd-e996d09483aa" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-14a3709d-3542-4d6d-8dfd-e996d09483aa" released by "delete_volume" :: held 0.979s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Acquiring lock "cinder-quobyte-fc114c30-4c52-416a-bfd3-3def42ee7c84" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-fc114c30-4c52-416a-bfd3-3def42ee7c84" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4725292-160c-42c2-8014-dfe8edd23bb0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:35 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 Jul 17 14:18:35 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:35 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84" returned: 0 in 0.559s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:35 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84 Jul 17 14:18:35 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:36 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc114c30-4c52-416a-bfd3-3def42ee7c84" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "cinder-quobyte-fc114c30-4c52-416a-bfd3-3def42ee7c84" released by "delete_volume" :: held 0.968s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Created reservations ['a2bae42d-9fed-42c4-b149-d9b62f0c2f1a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:36 devstack cinder-volume[87804]: WARNING cinder.quota [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1578953535 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1578953535, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:36 devstack cinder-volume[87804]: WARNING cinder.quota [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1578953535 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1578953535, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Created reservations ['ca25f0c6-9ca9-4d98-a001-5824e453f630', '9e2c26e1-7eaf-4a24-b827-9c677a74feb9', '8d5a8d73-b480-43f4-87e2-813fbadfc485', 'e46b1b82-f775-49e9-83cd-44877dd8869e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Created reservations ['3c2d4683-e8ba-41ae-bd25-3078aa9d7059', '9e5c4f92-bbe5-40fd-ab10-ce8113a1abe9', 'ef65b482-6fd5-4243-91db-50df0d4ec3c7', '5f533928-a130-4baa-bd44-891102a614b9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:36 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:18:36 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:37 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:37 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:18:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8cd181fe-3d75-4174-b416-1fc1e1d668e7 tempest-GroupsTest-1989894092 None] Delete group completed successfully. Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Flow 'volume_create_manager' (6ee6ce54-4f6e-4fd9-9711-6f9c65f77adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c1907-8423-461d-b803-4eafd9d71ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c1907-8423-461d-b803-4eafd9d71ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-985081597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cb2c3d-9433-43f1-9000-c978b8874e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416ff49d5c19407694f40e3285d07702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:46Z,use_quota=True,user_id='b67dd8d7044946e48418953a32871566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d240d72b-532d-4040-86c2-db31bd11c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d240d72b-532d-4040-86c2-db31bd11c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95031f63-f339-45c8-aeae-fc1c00c42903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95031f63-f339-45c8-aeae-fc1c00c42903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cb2c3d-9433-43f1-9000-c978b8874e11', 'volume_name': 'volume-d2cb2c3d-9433-43f1-9000-c978b8874e11', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf18583-69fd-484d-995f-fc839c301e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf18583-69fd-484d-995f-fc839c301e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3daf579-b740-4efb-bd25-644c01f71f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Volume d2cb2c3d-9433-43f1-9000-c978b8874e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cb2c3d-9433-43f1-9000-c978b8874e11', 'volume_size': 1} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-985081597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cb2c3d-9433-43f1-9000-c978b8874e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416ff49d5c19407694f40e3285d07702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:18:46Z,use_quota=True,user_id='b67dd8d7044946e48418953a32871566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Creating volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:18:45 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:18:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:45 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 1073741824 Jul 17 14:18:45 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:46 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 1073741824" returned: 0 in 0.678s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:46 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 Jul 17 14:18:46 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:46 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11" returned: 0 in 0.340s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3daf579-b740-4efb-bd25-644c01f71f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cb2c3d-9433-43f1-9000-c978b8874e11', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78b1ad6-70a1-4f00-a726-39c041e0ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:18:46 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Volume volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 (d2cb2c3d-9433-43f1-9000-c978b8874e11): created successfully Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78b1ad6-70a1-4f00-a726-39c041e0ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:18:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Flow 'volume_create_manager' (6ee6ce54-4f6e-4fd9-9711-6f9c65f77adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:18:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3840e46d-4719-40a8-a85e-495402d335a6 tempest-SnapshotsActionsTest-838391668 None] Created volume successfully. Jul 17 14:18:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Creating offline snapshot 88d84dc4-87f6-4072-8bb9-eb3a05e24eed of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:18:48 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ae06d-7a63-4cbe-82e7-7f46f1a7b41a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:48 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 Jul 17 14:18:48 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:49 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11" returned: 0 in 0.809s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:49 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed 1G Jul 17 14:18:49 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:50 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed 1G" returned: 0 in 1.126s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:50 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:18:50 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:51 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.642s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:51 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed is being set with open permissions: ugo+rw Jul 17 14:18:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:51 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:18:51 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:51 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.556s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:51 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info Jul 17 14:18:51 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:52 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info" returned: 0 in 0.489s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:52 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info is being set with open permissions: ugo+rw Jul 17 14:18:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:52 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info Jul 17 14:18:52 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:52 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.info" returned: 0 in 0.595s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.409s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:18:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b5e9916d-e246-4edf-9a41-f5ab7840ef02 tempest-SnapshotsActionsTest-838391668 None] Create snapshot completed successfully Jul 17 14:18:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:18:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:18:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Creating offline snapshot f34d7532-a4f0-49df-b4f6-7618eae98d38 of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:18:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[14944061-253f-4421-8e2e-a5caad868a07]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:18:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:55 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:18:55 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:56 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 1.007s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:18:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:56 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 1G Jul 17 14:18:56 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:58 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 1G" returned: 0 in 1.823s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:58 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 Jul 17 14:18:58 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:59 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 17 14:18:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38" returned: 0 in 0.749s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:18:59 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 is being set with open permissions: ugo+rw Jul 17 14:18:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:18:59 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 Jul 17 14:18:59 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:18:59 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38" returned: 0 in 0.817s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.732s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-bd33c504-2d66-4097-a46e-31568f1db70e tempest-SnapshotsActionsTest-838391668 None] Create snapshot completed successfully Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-f34d7532-a4f0-49df-b4f6-7618eae98d38-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-f34d7532-a4f0-49df-b4f6-7618eae98d38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-f34d7532-a4f0-49df-b4f6-7618eae98d38" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-f34d7532-a4f0-49df-b4f6-7618eae98d38" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Deleting offline snapshot f34d7532-a4f0-49df-b4f6-7618eae98d38 of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] snapshot_file for this snap is: volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b2a4a-ab2d-49b0-a60f-290f8135e007]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:01 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 Jul 17 14:19:01 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:02 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38" returned: 0 in 0.984s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f4d26-3404-499f-99fd-5e249ddd48e9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:03 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:03 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:03 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 1.014s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:03 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 Jul 17 14:19:03 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:04 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38" returned: 0 in 1.187s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:04 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38 Jul 17 14:19:04 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:05 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f34d7532-a4f0-49df-b4f6-7618eae98d38" returned: 0 in 0.546s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-f34d7532-a4f0-49df-b4f6-7618eae98d38" released by "_delete_snapshot" :: held 3.969s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_snapshot" :: held 4.019s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Created reservations ['c52b42f9-dc5d-49ee-89a2-327ffa0c96d0', '36d81dc8-6a89-4590-ae4f-5701bbecfcbe', '9df01d41-d378-41c5-a02b-846e0f1dde4c', 'b96cd30b-e2bb-43b0-b38f-3d61767f89b4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Delete snapshot completed successfully. Jul 17 14:19:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-199aa9bb-3f88-4c28-a701-aaa243715855 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-f34d7532-a4f0-49df-b4f6-7618eae98d38-delete_snapshot" released by "delete_snapshot" :: held 4.421s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Creating offline snapshot c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:19:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525eef5-9e53-4920-8235-d96ddea9a5db]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:06 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:06 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:07 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.721s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:07 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e 1G Jul 17 14:19:07 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:08 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e 1G" returned: 0 in 1.126s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:08 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e Jul 17 14:19:08 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:09 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" returned: 0 in 0.677s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:09 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e is being set with open permissions: ugo+rw Jul 17 14:19:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:09 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e Jul 17 14:19:09 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:09 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" returned: 0 in 0.442s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.234s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-38d8a521-4acc-472a-90f7-dd618d34c3b2 tempest-SnapshotsActionsTest-838391668 None] Create snapshot completed successfully Jul 17 14:19:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Flow 'volume_create_manager' (48d1d736-ba8d-45bb-83e3-a00c6ceca659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d76d899-ece5-4c55-b495-33180f329511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d76d899-ece5-4c55-b495-33180f329511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1227672074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62fca40-f28c-4fe8-9d05-ecdaf2788bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bb4ef4470483893b817e571f3bc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:10Z,use_quota=True,user_id='ca52e1aafc4346c6b45d82acb32569d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e16bf-4ac5-4075-a58d-f476b5ef1de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e16bf-4ac5-4075-a58d-f476b5ef1de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec81c49-44e5-4342-a007-f12d206ae979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec81c49-44e5-4342-a007-f12d206ae979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62fca40-f28c-4fe8-9d05-ecdaf2788bc2', 'volume_name': 'volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0284758-ceda-42df-9197-ad328d17e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0284758-ceda-42df-9197-ad328d17e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7ce33d-4d6e-4241-a888-d7a735d0337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:10 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Volume e62fca40-f28c-4fe8-9d05-ecdaf2788bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2', 'volume_size': 1} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1227672074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62fca40-f28c-4fe8-9d05-ecdaf2788bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704bb4ef4470483893b817e571f3bc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:10Z,use_quota=True,user_id='ca52e1aafc4346c6b45d82acb32569d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Creating volume e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:10 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 1073741824 Jul 17 14:19:10 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:11 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 1073741824" returned: 0 in 0.889s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:11 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 Jul 17 14:19:11 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Deleting offline snapshot c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] snapshot_file for this snap is: volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec65c81-0147-4653-8d55-ee1f7756c817]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:11 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" returned: 0 in 0.789s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7ce33d-4d6e-4241-a888-d7a735d0337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f545b3-91ce-44de-8959-14c1286202e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:12 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e Jul 17 14:19:12 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Volume volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 (e62fca40-f28c-4fe8-9d05-ecdaf2788bc2): created successfully Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f545b3-91ce-44de-8959-14c1286202e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Flow 'volume_create_manager' (48d1d736-ba8d-45bb-83e3-a00c6ceca659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9cce2a08-3881-4093-b50a-eff3dae42aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Created volume successfully. Jul 17 14:19:12 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" returned: 0 in 1.193s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb10efd-062d-452b-89bd-823e93a5c646]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:13 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:13 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Creating offline snapshot b0d6d011-104f-446f-9369-7fd1bfc5be0c of volume e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9106e4a-adb2-4edb-8b52-6239795214a3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:14 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 1.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:14 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e Jul 17 14:19:14 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:14 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 Jul 17 14:19:14 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:15 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" returned: 0 in 0.736s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:15 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e Jul 17 14:19:15 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:15 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" returned: 0 in 0.899s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:15 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c 1G Jul 17 14:19:15 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:15 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e" released by "_delete_snapshot" :: held 3.936s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_snapshot" :: held 3.996s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Created reservations ['a9d20534-9fba-493e-9b2d-d7209a0a2b08', '700f6bc9-c03d-4a03-9f14-c844391cf7e0', 'd2b14313-200d-426a-a3ae-a1e402b70567', '234c4520-f62a-4bf1-95b7-a7c2388099e4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Delete snapshot completed successfully. Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9f4f89c-c5de-4e39-8a25-77f2b08e9c40 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-c86eefd5-84e0-4f1f-96f3-7a3cdbac5c3e-delete_snapshot" released by "delete_snapshot" :: held 4.288s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:15 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c 1G" returned: 0 in 0.609s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:15 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c Jul 17 14:19:15 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:16 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c" returned: 0 in 0.370s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:16 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c is being set with open permissions: ugo+rw Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:16 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c Jul 17 14:19:16 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:16 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c" returned: 0 in 0.273s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:16 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info Jul 17 14:19:16 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:16 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info" returned: 0 in 0.283s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:16 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info is being set with open permissions: ugo+rw Jul 17 14:19:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:16 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info Jul 17 14:19:16 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:17 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.info" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.791s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Creating offline snapshot 6cf7bed3-a119-4d8a-999c-a194e819dbec of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e709c8a-9d76-4f6a-b6ef-3a47c60b9c19]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-afcad150-b228-485c-ad66-c5f6afbefe0d tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Create snapshot completed successfully Jul 17 14:19:17 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:17 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Flow 'volume_create_manager' (9e997cb8-d87b-43b6-8164-0c130e2ff365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a88b78-b86b-41ce-9465-253cc6720ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a88b78-b86b-41ce-9465-253cc6720ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-631705894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7fb33-7624-4165-9d31-ac1ec77891c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b387ead244b6282c29c58842bda82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:17Z,use_quota=True,user_id='c7bed4b0db514b4f88ece701d4b218d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2948a064-63a2-41ed-ab6b-c9c114f63d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2948a064-63a2-41ed-ab6b-c9c114f63d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824e5ba9-f861-42f9-b769-31fdff821d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824e5ba9-f861-42f9-b769-31fdff821d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d7fb33-7624-4165-9d31-ac1ec77891c0', 'volume_name': 'volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea852aa-e60a-459a-b2de-ce3a8a43bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea852aa-e60a-459a-b2de-ce3a8a43bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52daa41b-bc75-48c8-bce3-18c95e3c8cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Volume b4d7fb33-7624-4165-9d31-ac1ec77891c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0', 'volume_size': 1} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:17 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.481s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:17 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec 1G Jul 17 14:19:17 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:18 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec 1G" returned: 0 in 0.515s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:18 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec Jul 17 14:19:18 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:18 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:18 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec is being set with open permissions: ugo+rw Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:18 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec Jul 17 14:19:18 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "cinder-b0d6d011-104f-446f-9369-7fd1bfc5be0c-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:18 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-b0d6d011-104f-446f-9369-7fd1bfc5be0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec" returned: 0 in 0.320s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "cinder-quobyte-b0d6d011-104f-446f-9369-7fd1bfc5be0c" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.337s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-631705894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7fb33-7624-4165-9d31-ac1ec77891c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b387ead244b6282c29c58842bda82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:17Z,use_quota=True,user_id='c7bed4b0db514b4f88ece701d4b218d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Creating volume b4d7fb33-7624-4165-9d31-ac1ec77891c0 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:18 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-b0d6d011-104f-446f-9369-7fd1bfc5be0c" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:19 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 1073741824 Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Deleting offline snapshot b0d6d011-104f-446f-9369-7fd1bfc5be0c of volume e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:19 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] snapshot_file for this snap is: volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a5ad8672-4a10-4c48-9a00-8a0d8a68cfbb tempest-SnapshotsActionsTest-838391668 None] Create snapshot completed successfully Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976595d-e587-4dfd-857b-4bfb378228f7]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:19 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c Jul 17 14:19:19 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:19 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 1073741824" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:19 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c" returned: 0 in 0.491s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c666bd55-ded5-4038-962b-31aabd3070ee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-6cf7bed3-a119-4d8a-999c-a194e819dbec-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-6cf7bed3-a119-4d8a-999c-a194e819dbec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:19 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:19 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-6cf7bed3-a119-4d8a-999c-a194e819dbec" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-6cf7bed3-a119-4d8a-999c-a194e819dbec" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Deleting offline snapshot 6cf7bed3-a119-4d8a-999c-a194e819dbec of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:19 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 Jul 17 14:19:19 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] snapshot_file for this snap is: volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d7505-58a6-47ab-a748-2d61c442adc3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:19 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec Jul 17 14:19:19 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:19 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0" returned: 0 in 0.327s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52daa41b-bc75-48c8-bce3-18c95e3c8cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b67714-783b-41d2-a3d7-6d18e652e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Volume volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 (b4d7fb33-7624-4165-9d31-ac1ec77891c0): created successfully Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b67714-783b-41d2-a3d7-6d18e652e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Flow 'volume_create_manager' (9e997cb8-d87b-43b6-8164-0c130e2ff365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1141f4d9-4372-4572-a8da-7796946622dd tempest-ServersNegativeTestJSON-445558121 None] Created volume successfully. Jul 17 14:19:20 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:20 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c Jul 17 14:19:20 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:20 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec" returned: 0 in 0.510s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ad9a3-24dd-45e4-9ade-15cbf75fce6b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:20 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:20 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:20 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:20 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c Jul 17 14:19:20 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:20 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.447s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:20 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec Jul 17 14:19:20 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:20 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2.b0d6d011-104f-446f-9369-7fd1bfc5be0c" returned: 0 in 0.315s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-b0d6d011-104f-446f-9369-7fd1bfc5be0c" released by "_delete_snapshot" :: held 1.840s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" released by "delete_snapshot" :: held 1.921s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Created reservations ['995dac3f-b051-492e-8431-98b9f59e14fb', 'adc92bc0-792f-432f-9e33-eca3f6f78264', '97becf8a-4c62-4d19-8704-24f0623f5a6c', 'ce79693c-eb7c-4d42-b078-a27ea71827c5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Delete snapshot completed successfully. Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ad8a9fb9-2c65-426c-890b-6db114dbbaba tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-b0d6d011-104f-446f-9369-7fd1bfc5be0c-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "cinder-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:21 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec" returned: 0 in 0.561s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db6221-9da1-4b64-aa08-afd4c0f6aabb]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:21 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec Jul 17 14:19:21 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:21 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 Jul 17 14:19:21 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:21 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.6cf7bed3-a119-4d8a-999c-a194e819dbec" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-6cf7bed3-a119-4d8a-999c-a194e819dbec" released by "_delete_snapshot" :: held 1.941s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_snapshot" :: held 1.972s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Created reservations ['ed41c740-39eb-460d-af01-6d30a77ca465', '7dd047a2-67a4-492b-8b69-c4a3d2790e96', 'a73ebede-621f-4002-994d-5c198bac5a32', '040e6277-b2d9-499f-aac8-ea25a9924b0a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:21 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:21 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2 Jul 17 14:19:21 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Delete snapshot completed successfully. Jul 17 14:19:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba0083f3-0cbd-4c19-b915-da24aa8a7f07 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-6cf7bed3-a119-4d8a-999c-a194e819dbec-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:22 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" returned: 0 in 0.276s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-quobyte-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2" released by "delete_volume" :: held 0.843s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Created reservations ['daaf7276-bac2-4a4d-a0f2-d9a5a76bbd37', '03796878-f212-49e5-b130-c21c3a431894', 'f9b34bc5-d82e-4cd1-b0ba-130cd55029c4', '12921cf6-568e-47e7-824c-3dbea781dc6b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:22 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:22 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Flow 'volume_create_manager' (9f5eb116-755f-4b2a-9c7f-81f6fa4e71f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f576a4-c903-41e4-a951-bf4c088087b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f576a4-c903-41e4-a951-bf4c088087b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457602816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abba1bd0-168b-49f6-9869-1ab454dcca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b387ead244b6282c29c58842bda82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:22Z,use_quota=True,user_id='c7bed4b0db514b4f88ece701d4b218d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7305b57-4be6-4833-a2d7-4b9391d8b967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7305b57-4be6-4833-a2d7-4b9391d8b967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c21704e-081c-4912-a182-eddc2f48c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c21704e-081c-4912-a182-eddc2f48c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abba1bd0-168b-49f6-9869-1ab454dcca3f', 'volume_name': 'volume-abba1bd0-168b-49f6-9869-1ab454dcca3f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7646c1c3-7aa6-423a-a6a4-de6c40e83a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7646c1c3-7aa6-423a-a6a4-de6c40e83a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9f9d5a-6c70-49ed-a30c-641d93f8bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:22 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Volume abba1bd0-168b-49f6-9869-1ab454dcca3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abba1bd0-168b-49f6-9869-1ab454dcca3f', 'volume_size': 1} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457602816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abba1bd0-168b-49f6-9869-1ab454dcca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964b387ead244b6282c29c58842bda82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:22Z,use_quota=True,user_id='c7bed4b0db514b4f88ece701d4b218d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Creating volume abba1bd0-168b-49f6-9869-1ab454dcca3f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:22 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:22 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f 1073741824 Jul 17 14:19:22 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:22 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Deleted volume successfully. Jul 17 14:19:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b5cee1d-21e3-474d-a107-9ce8803b0061 tempest-VolumeSnapshotQuotasNegativeTestJSON-422737549 None] Lock "cinder-e62fca40-f28c-4fe8-9d05-ecdaf2788bc2-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:23 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f 1073741824" returned: 0 in 0.662s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:23 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f Jul 17 14:19:23 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:23 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.165s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Creating offline snapshot f0cbc9cc-ddfb-4344-9536-6b2749050826 of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9f9d5a-6c70-49ed-a30c-641d93f8bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abba1bd0-168b-49f6-9869-1ab454dcca3f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f6f9c9-a3af-4c26-b9b6-ba167774a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d07b348-bea8-4f1c-a236-28aaf694f4f0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:23 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Volume volume-abba1bd0-168b-49f6-9869-1ab454dcca3f (abba1bd0-168b-49f6-9869-1ab454dcca3f): created successfully Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f6f9c9-a3af-4c26-b9b6-ba167774a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Flow 'volume_create_manager' (9f5eb116-755f-4b2a-9c7f-81f6fa4e71f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:23 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3f653f9d-f641-43bf-822a-e67ca91fa3e4 tempest-ServersNegativeTestJSON-445558121 None] Created volume successfully. Jul 17 14:19:23 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:23 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:24 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.497s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:24 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 1G Jul 17 14:19:24 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:24 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 1G" returned: 0 in 0.600s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:24 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 Jul 17 14:19:24 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "cinder-abba1bd0-168b-49f6-9869-1ab454dcca3f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-abba1bd0-168b-49f6-9869-1ab454dcca3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:25 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826" returned: 0 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:25 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 is being set with open permissions: ugo+rw Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "cinder-quobyte-abba1bd0-168b-49f6-9869-1ab454dcca3f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:25 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-quobyte-abba1bd0-168b-49f6-9869-1ab454dcca3f" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:25 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa8549c-ea43-4165-a9e5-00bd7ac7d2d1]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:25 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f Jul 17 14:19:25 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:25 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826" returned: 0 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:25 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:25 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cae0a6f2-9cb4-4aaa-868e-8db1e758a70d tempest-SnapshotsActionsTest-838391668 None] Create snapshot completed successfully Jul 17 14:19:25 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f" returned: 0 in 0.506s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:25 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f Jul 17 14:19:25 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:26 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.411s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 8 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:19:26 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-abba1bd0-168b-49f6-9869-1ab454dcca3f" returned: 0 in 0.438s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-quobyte-abba1bd0-168b-49f6-9869-1ab454dcca3f" released by "delete_volume" :: held 1.003s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Created reservations ['f42b4d29-9d1f-4386-8deb-4621406cfc04', 'cd354e8d-2cf0-4b1d-afc5-45094f3e9401', 'd9875273-a5e7-429c-a751-ab7918aa1419', 'f142e440-47fc-41d7-8562-75fc8c822015'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (0afaee3a-05b6-4650-b284-9c224fe85bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404c9a0b-bfd9-46f8-85c4-1017b66edf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404c9a0b-bfd9-46f8-85c4-1017b66edf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1212016835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cfcede-ddc2-48fb-b0a6-ba74a416b920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:26Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae1128-99a2-456e-a8dd-4905d7f3a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae1128-99a2-456e-a8dd-4905d7f3a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc2d3a1-2e96-453b-85e7-1e2dbdb7a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc2d3a1-2e96-453b-85e7-1e2dbdb7a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83cfcede-ddc2-48fb-b0a6-ba74a416b920', 'volume_name': 'volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a5a1d-685d-4194-a18f-890b2aeb8b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a5a1d-685d-4194-a18f-890b2aeb8b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7173cdf4-157d-48ac-84cf-8ebc6f10c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Volume 83cfcede-ddc2-48fb-b0a6-ba74a416b920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920', 'volume_size': 1} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1212016835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cfcede-ddc2-48fb-b0a6-ba74a416b920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:26Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Creating volume 83cfcede-ddc2-48fb-b0a6-ba74a416b920 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:26 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:26 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 1073741824 Jul 17 14:19:26 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:26 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:26 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-f0cbc9cc-ddfb-4344-9536-6b2749050826-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-f0cbc9cc-ddfb-4344-9536-6b2749050826-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Acquiring lock "cinder-quobyte-f0cbc9cc-ddfb-4344-9536-6b2749050826" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-f0cbc9cc-ddfb-4344-9536-6b2749050826" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Deleting offline snapshot f0cbc9cc-ddfb-4344-9536-6b2749050826 of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] snapshot_file for this snap is: volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a22edb0-2b2b-481d-995f-6f457910f919]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:27 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Deleted volume successfully. Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1ee35d8e-8c77-4e13-9e99-42c99bf4dbae tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-abba1bd0-168b-49f6-9869-1ab454dcca3f-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:27 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 Jul 17 14:19:27 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:27 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 1073741824" returned: 0 in 0.615s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=113,cinder:SELECT=93,cinder:INSERT=28,cinder:DELETE=5 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:27 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 Jul 17 14:19:27 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:27 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826" returned: 0 in 0.517s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f66e69-3f90-46b9-865e-01a99714addf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "cinder-b4d7fb33-7624-4165-9d31-ac1ec77891c0-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-b4d7fb33-7624-4165-9d31-ac1ec77891c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:27 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "cinder-quobyte-b4d7fb33-7624-4165-9d31-ac1ec77891c0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7173cdf4-157d-48ac-84cf-8ebc6f10c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe5cdcd-7c6d-4e3e-ae5d-3aa242440d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:27 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:27 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Volume volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 (83cfcede-ddc2-48fb-b0a6-ba74a416b920): created successfully Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe5cdcd-7c6d-4e3e-ae5d-3aa242440d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (0afaee3a-05b6-4650-b284-9c224fe85bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-quobyte-b4d7fb33-7624-4165-9d31-ac1ec77891c0" acquired by "delete_volume" :: waited 0.050s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-639934c8-6377-45f4-add9-683bf44ee347 tempest-AttachVolumeTestJSON-431579605 None] Created volume successfully. Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[941fc221-1416-4c24-b0fa-51af4ef5124d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:27 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 Jul 17 14:19:27 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:28 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.495s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:28 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 Jul 17 14:19:28 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:28 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0" returned: 0 in 0.431s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:28 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0 Jul 17 14:19:28 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:28 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b4d7fb33-7624-4165-9d31-ac1ec77891c0" returned: 0 in 0.307s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-quobyte-b4d7fb33-7624-4165-9d31-ac1ec77891c0" released by "delete_volume" :: held 0.801s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=93,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:19:28 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826" returned: 0 in 0.524s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:28 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826 Jul 17 14:19:28 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Created reservations ['cef11518-c920-4adb-bfbc-5957f456244e', '917c56ad-8091-4912-b27e-72f2db81d33f', 'b6d53d2b-6202-4155-8f72-9f01fd9e270a', 'cdeafe48-40ad-4a62-8691-f7af93c7d065'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:28 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:28 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:28 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.f0cbc9cc-ddfb-4344-9536-6b2749050826" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-f0cbc9cc-ddfb-4344-9536-6b2749050826" released by "_delete_snapshot" :: held 2.087s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_snapshot" :: held 2.125s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Created reservations ['9eb65c84-05c6-4ff5-b49a-0c5d89739706', 'f790c041-4536-4396-a799-8e16b5987cf8', '494aeb14-1514-4890-893b-dfce5c3778bc', '68ee9f78-7c50-480c-892e-19acae338d1c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:29 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Deleted volume successfully. Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ac8cbcd1-cb85-45e2-a50c-e63be15249b3 tempest-ServersNegativeTestJSON-445558121 None] Lock "cinder-b4d7fb33-7624-4165-9d31-ac1ec77891c0-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Delete snapshot completed successfully. Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e033f44-99b1-41c0-b7b7-ff9da0bd3af2 tempest-SnapshotsActionsTest-1520117981 None] Lock "cinder-f0cbc9cc-ddfb-4344-9536-6b2749050826-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e70f3d89-7109-4cf8-a594-2a651001b538 req-1b2c7434-9b2f-483a-ab4b-77c3428545d3 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e70f3d89-7109-4cf8-a594-2a651001b538 req-1b2c7434-9b2f-483a-ab4b-77c3428545d3 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e70f3d89-7109-4cf8-a594-2a651001b538 req-1b2c7434-9b2f-483a-ab4b-77c3428545d3 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-e70f3d89-7109-4cf8-a594-2a651001b538 req-1b2c7434-9b2f-483a-ab4b-77c3428545d3 tempest-AttachVolumeTestJSON-431579605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f465feb-9dc3-48c0-8fca-878174c08551', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:19:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-e70f3d89-7109-4cf8-a594-2a651001b538 req-1b2c7434-9b2f-483a-ab4b-77c3428545d3 tempest-AttachVolumeTestJSON-431579605 None] attachment_update completed successfully. Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "cinder-88d84dc4-87f6-4072-8bb9-eb3a05e24eed-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-88d84dc4-87f6-4072-8bb9-eb3a05e24eed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "cinder-quobyte-88d84dc4-87f6-4072-8bb9-eb3a05e24eed" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-88d84dc4-87f6-4072-8bb9-eb3a05e24eed" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Deleting offline snapshot 88d84dc4-87f6-4072-8bb9-eb3a05e24eed of volume d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] snapshot_file for this snap is: volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac387e5-f199-4fe5-8f83-6c3fa869134b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:31 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:31 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:32 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.778s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2cb2c3d-9433-43f1-9000-c978b8874e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d668dc-00ec-44a8-8c41-e44ddc54d5ca]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:32 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 Jul 17 14:19:32 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:32 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11" returned: 0 in 0.720s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:32 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:32 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:33 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:33 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed Jul 17 14:19:33 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:33 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11.88d84dc4-87f6-4072-8bb9-eb3a05e24eed" returned: 0 in 0.335s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-88d84dc4-87f6-4072-8bb9-eb3a05e24eed" released by "_delete_snapshot" :: held 2.475s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_snapshot" :: held 2.532s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Created reservations ['2aad6571-675e-4f47-aef7-72bfb99637c8', 'd314ba34-3807-4df2-935d-e762f0f29ac8', '932c8d64-4121-4e4a-917a-f058adb8b483', 'a8c08bb4-183c-4112-92cf-887cdec1ba70'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Delete snapshot completed successfully. Jul 17 14:19:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2a72805-ed05-4c86-b5ec-297fb18a2993 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-88d84dc4-87f6-4072-8bb9-eb3a05e24eed-delete_snapshot" released by "delete_snapshot" :: held 2.785s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "cinder-d2cb2c3d-9433-43f1-9000-c978b8874e11-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-d2cb2c3d-9433-43f1-9000-c978b8874e11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9582491b-3c14-469c-835b-09d32f7b19cd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:34 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 Jul 17 14:19:34 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:35 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11" returned: 0 in 0.495s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:35 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11 Jul 17 14:19:35 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:35 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d2cb2c3d-9433-43f1-9000-c978b8874e11" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-quobyte-d2cb2c3d-9433-43f1-9000-c978b8874e11" released by "delete_volume" :: held 1.024s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Created reservations ['afdfb4bc-eb7e-44ea-a959-3c9dbc561404', '90db9224-b955-475a-be08-50bcb5fa4d6b', 'b59ada89-6fa1-4883-a009-b9753958952d', 'bd6c9ec2-d8bd-43a8-9624-9a312f3025cd'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:35 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:35 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:36 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.448s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:36 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Deleted volume successfully. Jul 17 14:19:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00cff8d5-8d93-4efd-81d9-f6d994eba330 tempest-SnapshotsActionsTest-838391668 None] Lock "cinder-d2cb2c3d-9433-43f1-9000-c978b8874e11-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:45 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=29,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=10 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:19:46 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:INSERT=6,cinder:UPDATE=23,cinder:SELECT=23,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:19:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0300f79c-7aef-4c48-9d33-b772f66f4882 tempest-GroupsV320Test-1887332593 None] Group tempest-GroupsV320Test-Group-1938046504: creating Jul 17 14:19:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0300f79c-7aef-4c48-9d33-b772f66f4882 tempest-GroupsV320Test-1887332593 None] Group tempest-GroupsV320Test-Group-1938046504: created successfully Jul 17 14:19:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0300f79c-7aef-4c48-9d33-b772f66f4882 tempest-GroupsV320Test-1887332593 None] Create group completed successfully. Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Flow 'volume_create_manager' (4952db2d-83b8-4fe2-a07b-de73d915d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ae92ae-5180-4e48-ba11-8298cae57a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ae92ae-5180-4e48-ba11-8298cae57a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-499025525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab0c2ec-4344-414f-9978-1e9c84711ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180179508834c088d8b9f711b3d84d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:49Z,use_quota=True,user_id='2f7e925724b247b28a1d66d910b478ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cb5f6-5d50-4fd0-9487-3a8d62b9a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cb5f6-5d50-4fd0-9487-3a8d62b9a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8ae61e-be72-42c0-a8b7-8593ba99091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8ae61e-be72-42c0-a8b7-8593ba99091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab0c2ec-4344-414f-9978-1e9c84711ebe', 'volume_name': 'volume-cab0c2ec-4344-414f-9978-1e9c84711ebe', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9940ad7-3428-48c1-a42a-2a17edbbb05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9940ad7-3428-48c1-a42a-2a17edbbb05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd385bfc-a740-45f1-9f66-412c00f52f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume cab0c2ec-4344-414f-9978-1e9c84711ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab0c2ec-4344-414f-9978-1e9c84711ebe', 'volume_size': 1} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-499025525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab0c2ec-4344-414f-9978-1e9c84711ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180179508834c088d8b9f711b3d84d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:49Z,use_quota=True,user_id='2f7e925724b247b28a1d66d910b478ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Creating volume cab0c2ec-4344-414f-9978-1e9c84711ebe {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:49 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:49 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe 1073741824 Jul 17 14:19:49 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Created reservations ['30c6ada6-54fa-4b8d-be6b-f68ac7028a4d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:49 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:49 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:50 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe 1073741824" returned: 0 in 0.743s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:50 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe Jul 17 14:19:50 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:50 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.609s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b3a64ad8-54d4-4fc7-9562-1ef9ff3fad8a tempest-GroupsV320Test-1887332593 None] Delete group completed successfully. Jul 17 14:19:50 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe" returned: 0 in 0.298s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd385bfc-a740-45f1-9f66-412c00f52f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab0c2ec-4344-414f-9978-1e9c84711ebe', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3737ed3b-1ed6-42c7-adc8-fa94bf866117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:50 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume volume-cab0c2ec-4344-414f-9978-1e9c84711ebe (cab0c2ec-4344-414f-9978-1e9c84711ebe): created successfully Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3737ed3b-1ed6-42c7-adc8-fa94bf866117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Flow 'volume_create_manager' (4952db2d-83b8-4fe2-a07b-de73d915d924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-12f1eb78-b107-43db-90af-a91f382a6d64 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Created volume successfully. Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "cinder-cab0c2ec-4344-414f-9978-1e9c84711ebe-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "cinder-cab0c2ec-4344-414f-9978-1e9c84711ebe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "cinder-quobyte-cab0c2ec-4344-414f-9978-1e9c84711ebe" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "cinder-quobyte-cab0c2ec-4344-414f-9978-1e9c84711ebe" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665144d-0afd-4776-be1c-2fee6c5a475c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:51 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe Jul 17 14:19:51 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:52 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:52 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe Jul 17 14:19:52 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:52 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cab0c2ec-4344-414f-9978-1e9c84711ebe" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "cinder-quobyte-cab0c2ec-4344-414f-9978-1e9c84711ebe" released by "delete_volume" :: held 0.858s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Created reservations ['83075fb7-58b9-4e80-8c8c-4f80fa8bd1ea', '80d27e48-9603-4dd0-bd4e-57fc3087c1d2', '643dd425-267d-4e72-a641-76a88aff26df', '4c0e083b-eddd-4bec-baac-a00134a6386e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:52 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:52 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:53 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.502s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Deleted volume successfully. Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-48ac9c78-3f07-4f3f-9775-f26bdd14a47c tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "cinder-cab0c2ec-4344-414f-9978-1e9c84711ebe-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Flow 'volume_create_manager' (80afbbc4-43c1-4d03-b205-df9a64e45fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc0b4b4-c011-42ad-a9e9-6eccf9610d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc0b4b4-c011-42ad-a9e9-6eccf9610d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-135886110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56885da-f141-4993-861b-1161828e14cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180179508834c088d8b9f711b3d84d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:54Z,use_quota=True,user_id='2f7e925724b247b28a1d66d910b478ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7cbb09-08dc-42b8-a430-773365513250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7cbb09-08dc-42b8-a430-773365513250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6eefec-ea84-4d47-8bae-f176d8f20c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6eefec-ea84-4d47-8bae-f176d8f20c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56885da-f141-4993-861b-1161828e14cf', 'volume_name': 'volume-e56885da-f141-4993-861b-1161828e14cf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecd30a7-250f-4b1f-8326-2fd8933946c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecd30a7-250f-4b1f-8326-2fd8933946c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f157ff-d426-4ffc-9b3f-caa55cd5385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:53 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume e56885da-f141-4993-861b-1161828e14cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56885da-f141-4993-861b-1161828e14cf', 'volume_size': 1} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-135886110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56885da-f141-4993-861b-1161828e14cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180179508834c088d8b9f711b3d84d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:54Z,use_quota=True,user_id='2f7e925724b247b28a1d66d910b478ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Creating volume e56885da-f141-4993-861b-1161828e14cf {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:53 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:53 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf 1073741824 Jul 17 14:19:53 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:54 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf 1073741824" returned: 0 in 0.650s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:54 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf Jul 17 14:19:54 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:54 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf" returned: 0 in 0.301s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f157ff-d426-4ffc-9b3f-caa55cd5385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56885da-f141-4993-861b-1161828e14cf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9b32c1-8f31-4c54-a3b4-d4c1a1f2aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:54 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Volume volume-e56885da-f141-4993-861b-1161828e14cf (e56885da-f141-4993-861b-1161828e14cf): created successfully Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9b32c1-8f31-4c54-a3b4-d4c1a1f2aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Flow 'volume_create_manager' (80afbbc4-43c1-4d03-b205-df9a64e45fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f73318ab-9092-4e54-a2e8-72f60bbacc10 tempest-VolumeQuotasAdminTestJSON-1112561324 None] Created volume successfully. Jul 17 14:19:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0ff7f225-95de-4fb3-ba78-671b59d0707b tempest-VolumeQuotasAdminTestJSON-1693034285 None] Transfer volume completed successfully. Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Flow 'volume_create_manager' (eab14f67-2713-4c45-b526-50a1cbf3db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd982c45-84ab-489e-8b2e-577beb551684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd982c45-84ab-489e-8b2e-577beb551684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2107164985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2690b6a-6e32-44f4-84ec-4f9b55a6b74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7830d9cc8c4af8b8a0fad8ce65ad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:57Z,use_quota=True,user_id='64f57c17de5d49fda1c341c9c3e8b20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdb81cd-9a67-434a-8e91-4a173e18574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdb81cd-9a67-434a-8e91-4a173e18574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea58766-3120-4648-ba68-432b9b51559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Acquiring lock "cinder-e56885da-f141-4993-861b-1161828e14cf-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "cinder-e56885da-f141-4993-861b-1161828e14cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Acquiring lock "cinder-quobyte-e56885da-f141-4993-861b-1161828e14cf" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "cinder-quobyte-e56885da-f141-4993-861b-1161828e14cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e5947-eaba-4df0-a92e-eea2058f6f4d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:57 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf Jul 17 14:19:57 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:58 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf" returned: 0 in 0.468s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea58766-3120-4648-ba68-432b9b51559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2690b6a-6e32-44f4-84ec-4f9b55a6b74c', 'volume_name': 'volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8554157e-d7b8-4f0b-82ec-1f27f83b9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:58 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf Jul 17 14:19:58 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8554157e-d7b8-4f0b-82ec-1f27f83b9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c946e240-2a48-40b7-897f-a24a8558b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:19:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Trying to clone c2690b6a-6e32-44f4-84ec-4f9b55a6b74c from image fe33b284-d390-4ad6-9a67-4047a22fe63a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:19:58 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e56885da-f141-4993-861b-1161828e14cf" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "cinder-quobyte-e56885da-f141-4993-861b-1161828e14cf" released by "delete_volume" :: held 0.846s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:19:58 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Image download 20.69 MB at 20.69 MB/s Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Created reservations ['c16ab844-fed0-43f1-af6c-c95d201067ff', 'b523eea9-52a6-4814-b0ca-05127412d8b2', 'ed8da5fd-acef-4dfb-a4c5-58c851a6a64a', '0c7a9e89-6f7e-44e7-a8d0-d6a5b228da7e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06694676-4f29-4f83-ae97-dd065c30536c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:58 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:19:58 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:58 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD Jul 17 14:19:58 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:58 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:19:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Deleted volume successfully. Jul 17 14:19:58 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:58 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a is fetched for user 64f57c17de5d49fda1c341c9c3e8b20d. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3455d7e3-6489-4ca1-8542-13b95167df1e tempest-VolumeQuotasAdminTestJSON-2004216342 None] Lock "cinder-e56885da-f141-4993-861b-1161828e14cf-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e0c0f7-58ac-48ca-b233-a349e4a4bf9f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:59 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD Jul 17 14:19:59 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:59 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2107164985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2690b6a-6e32-44f4-84ec-4f9b55a6b74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7830d9cc8c4af8b8a0fad8ce65ad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:19:57Z,use_quota=True,user_id='64f57c17de5d49fda1c341c9c3e8b20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Creating volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:19:59 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:19:59 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1073741824 Jul 17 14:19:59 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:19:59 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 17 14:19:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1073741824" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:00 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c Jul 17 14:20:00 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:00 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Attempting download of fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a6c6b-9155-46c5-bfd2-9cf40a4ec6d1]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:00 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws Jul 17 14:20:00 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:00 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:01 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws Jul 17 14:20:01 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:01 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws" returned: 1 in 0.482s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_vm45dhws' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:20:01 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc82c16-a12f-420e-ae99-d9694fc91c23]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:01 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD Jul 17 14:20:01 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:02 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:02 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] fe33b284-d390-4ad6-9a67-4047a22fe63a was qcow2, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:20:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:02 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c Jul 17 14:20:02 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-8e2dfc59-f0f2-4e71-bfec-d61bd1140df4 req-e1c48b0a-3891-4d70-b032-d71d9d975f45 tempest-AttachVolumeTestJSON-431579605 None] Terminate volume connection completed successfully. Jul 17 14:20:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-8e2dfc59-f0f2-4e71-bfec-d61bd1140df4 req-e1c48b0a-3891-4d70-b032-d71d9d975f45 tempest-AttachVolumeTestJSON-431579605 None] Deleting attachment 3f465feb-9dc3-48c0-8fca-878174c08551. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:20:04 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" returned: 0 in 2.631s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:04 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_0kp7_5yqdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:20:04 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Converted 112.00 MB image at 42.55 MB/s Jul 17 14:20:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:04 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1G Jul 17 14:20:04 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:05 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c 1G" returned: 0 in 0.523s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Downloaded image fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a for user 64f57c17de5d49fda1c341c9c3e8b20d is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Marking volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Copying metadata from image fe33b284-d390-4ad6-9a67-4047a22fe63a to c2690b6a-6e32-44f4-84ec-4f9b55a6b74c. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Creating volume glance metadata for volume c2690b6a-6e32-44f4-84ec-4f9b55a6b74c backed by image fe33b284-d390-4ad6-9a67-4047a22fe63a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c946e240-2a48-40b7-897f-a24a8558b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d59494-395d-419b-bdcb-dc240f156b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:05 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Volume volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c (c2690b6a-6e32-44f4-84ec-4f9b55a6b74c): created successfully Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d59494-395d-419b-bdcb-dc240f156b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Flow 'volume_create_manager' (eab14f67-2713-4c45-b526-50a1cbf3db1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ee06ea53-ecc2-4630-89c6-ec8e587aa894 tempest-VolumesImageMetadata-717118774 None] Created volume successfully. Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Acquiring lock "cinder-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "cinder-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Acquiring lock "cinder-quobyte-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "cinder-quobyte-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5766582-4f8c-4086-ac59-65699a293e3d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:06 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c Jul 17 14:20:06 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:07 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" returned: 0 in 0.667s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:07 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c Jul 17 14:20:07 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:07 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" returned: 0 in 0.387s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "cinder-quobyte-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c" released by "delete_volume" :: held 1.119s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Created reservations ['1e0173d1-1815-433a-98e2-7c6c9953075b', 'e9e31ae6-0e7f-4946-8536-fbbf52efdeb9', 'a492028b-b4c8-4398-b4ea-e47bb8779f86', 'fa122fd1-8e20-45ad-a93c-3a0126cec0c9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:07 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:07 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:08 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:08 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Deleted volume successfully. Jul 17 14:20:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ffdd9ce0-8d52-4a33-bbd1-bde3c87c51e7 tempest-VolumesImageMetadata-717118774 None] Lock "cinder-c2690b6a-6e32-44f4-84ec-4f9b55a6b74c-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Flow 'volume_create_manager' (a63991aa-27c1-4803-bd37-94d0402dad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd5393-040f-4efc-b736-f5593d7ee0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd5393-040f-4efc-b736-f5593d7ee0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2141365590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe749834-555e-4fec-a98e-8ed4fed0edc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4afa4a13c6f4fe8a70c7341c5ec8d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:09Z,use_quota=True,user_id='879230857e8441d584688ca7c2a8edba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4b6dcb-737a-4733-be0a-f0979b3c20c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4b6dcb-737a-4733-be0a-f0979b3c20c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3f6243-f3b5-4b98-a606-17f34a011aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3f6243-f3b5-4b98-a606-17f34a011aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe749834-555e-4fec-a98e-8ed4fed0edc5', 'volume_name': 'volume-fe749834-555e-4fec-a98e-8ed4fed0edc5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621d166-538d-4df6-943e-52ec9008430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621d166-538d-4df6-943e-52ec9008430c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d467d3-b473-4d0a-92e5-1fca3fa4e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Volume fe749834-555e-4fec-a98e-8ed4fed0edc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe749834-555e-4fec-a98e-8ed4fed0edc5', 'volume_size': 1} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2141365590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe749834-555e-4fec-a98e-8ed4fed0edc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4afa4a13c6f4fe8a70c7341c5ec8d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:09Z,use_quota=True,user_id='879230857e8441d584688ca7c2a8edba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Creating volume fe749834-555e-4fec-a98e-8ed4fed0edc5 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:09 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:09 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 1073741824 Jul 17 14:20:09 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:10 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 1073741824" returned: 0 in 1.048s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:10 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 Jul 17 14:20:10 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:11 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d467d3-b473-4d0a-92e5-1fca3fa4e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe749834-555e-4fec-a98e-8ed4fed0edc5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f1efc2-e7bd-447d-bbfd-d11452d6e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Volume volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 (fe749834-555e-4fec-a98e-8ed4fed0edc5): created successfully Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f1efc2-e7bd-447d-bbfd-d11452d6e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Flow 'volume_create_manager' (a63991aa-27c1-4803-bd37-94d0402dad89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ed5290b6-4649-41d2-bb47-87ee14bd527f tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Created volume successfully. Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Acquiring lock "cinder-fe749834-555e-4fec-a98e-8ed4fed0edc5-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "cinder-fe749834-555e-4fec-a98e-8ed4fed0edc5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Acquiring lock "cinder-quobyte-fe749834-555e-4fec-a98e-8ed4fed0edc5" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "cinder-quobyte-fe749834-555e-4fec-a98e-8ed4fed0edc5" acquired by "delete_volume" :: waited 0.049s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d3de1-d718-45b3-aba3-b550c1def689]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:14 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 Jul 17 14:20:14 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:15 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5" returned: 0 in 0.582s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:15 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5 Jul 17 14:20:15 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:15 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fe749834-555e-4fec-a98e-8ed4fed0edc5" returned: 0 in 0.545s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "cinder-quobyte-fe749834-555e-4fec-a98e-8ed4fed0edc5" released by "delete_volume" :: held 1.225s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Created reservations ['3bc53118-341a-44bc-b346-875fb7a4ed43', 'c1c441cf-c8c0-4fc0-8bd5-80846f1b1ea0', '2b5ad154-d9f6-44c9-8ea0-ddf21ceb9666', '5419a561-aeea-4120-aa5b-1e9cf748ab98'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:15 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:15 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:16 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.409s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Deleted volume successfully. Jul 17 14:20:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d09cf060-819e-406e-803a-2818fe39e22e tempest-VolumeQuotasNegativeTestJSON-1628542081 None] Lock "cinder-fe749834-555e-4fec-a98e-8ed4fed0edc5-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (00418592-c4c6-4db9-80f3-e2d17e72e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae2adb7-8bba-47fd-bad0-a1417ea21722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae2adb7-8bba-47fd-bad0-a1417ea21722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095736563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32aab065-05b2-44a4-a936-281c1b69aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b901b03eeaaa4a85bb45cd3c040617e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:20Z,use_quota=True,user_id='b476316df2fb4d2f8a2619c234ecd5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be66f130-2c70-434a-be96-62261f5ce62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be66f130-2c70-434a-be96-62261f5ce62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472315c-cbb1-4e75-9bea-ecf167b4b421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d472315c-cbb1-4e75-9bea-ecf167b4b421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32aab065-05b2-44a4-a936-281c1b69aaac', 'volume_name': 'volume-32aab065-05b2-44a4-a936-281c1b69aaac', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a63a3e3-2208-44fd-ab50-aeee31f06512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a63a3e3-2208-44fd-ab50-aeee31f06512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f807037-1261-441c-8ff0-cdee2a8bea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Volume 32aab065-05b2-44a4-a936-281c1b69aaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32aab065-05b2-44a4-a936-281c1b69aaac', 'volume_size': 1} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095736563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32aab065-05b2-44a4-a936-281c1b69aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b901b03eeaaa4a85bb45cd3c040617e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:20Z,use_quota=True,user_id='b476316df2fb4d2f8a2619c234ecd5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Creating volume 32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:20 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:20 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac 1073741824 Jul 17 14:20:20 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:21 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac 1073741824" returned: 0 in 0.846s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:21 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac Jul 17 14:20:21 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:21 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac" returned: 0 in 0.412s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f807037-1261-441c-8ff0-cdee2a8bea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32aab065-05b2-44a4-a936-281c1b69aaac', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac48056b-3500-42ae-8cf6-832c5e8ccd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Volume volume-32aab065-05b2-44a4-a936-281c1b69aaac (32aab065-05b2-44a4-a936-281c1b69aaac): created successfully Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac48056b-3500-42ae-8cf6-832c5e8ccd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (00418592-c4c6-4db9-80f3-e2d17e72e12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d24cf066-984f-4d6a-93cb-67e04f12fce0 tempest-VolumesDeleteCascade-2071272686 None] Created volume successfully. Jul 17 14:20:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Creating offline snapshot c593b73d-df28-492b-b122-912e298725f9 of volume 32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:20:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20976d-7e81-45c8-840a-14ebc3192939]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:23 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac Jul 17 14:20:23 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:23 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac" returned: 0 in 0.585s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:23 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 1G Jul 17 14:20:23 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:24 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 1G" returned: 0 in 0.653s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:24 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:24 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:24 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.425s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:24 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 is being set with open permissions: ugo+rw Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:24 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:24 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:24 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.328s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:24 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info Jul 17 14:20:24 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:25 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info" returned: 0 in 0.324s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:25 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info is being set with open permissions: ugo+rw Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:25 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info Jul 17 14:20:25 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:25 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.info" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:25 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:25 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d36c0568-2c37-4b76-8827-684a07f6f5af tempest-VolumesDeleteCascade-2071272686 None] Create snapshot completed successfully Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (605b31be-729b-4b5e-9a36-9619f582db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6760a735-ee1a-43c1-8f1f-8e1e56a46eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6760a735-ee1a-43c1-8f1f-8e1e56a46eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-57935572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f025a0ea-9b05-40f5-98a5-d8c56cdc111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:26Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ae72c1-481d-439e-ab97-fb6d51df52c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ae72c1-481d-439e-ab97-fb6d51df52c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afbaea-b201-496a-bf14-624ce713060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36afbaea-b201-496a-bf14-624ce713060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f025a0ea-9b05-40f5-98a5-d8c56cdc111f', 'volume_name': 'volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fd134e-74d7-4658-8fae-786c278c2373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fd134e-74d7-4658-8fae-786c278c2373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4de12-11a1-40eb-8de8-7d0be6b583f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:25 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Volume f025a0ea-9b05-40f5-98a5-d8c56cdc111f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f', 'volume_size': 1} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-57935572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f025a0ea-9b05-40f5-98a5-d8c56cdc111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:26Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Creating volume f025a0ea-9b05-40f5-98a5-d8c56cdc111f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:25 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:25 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f 1073741824 Jul 17 14:20:25 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:25 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.325s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 28 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:20:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:26 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f 1073741824" returned: 0 in 0.573s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:26 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f Jul 17 14:20:26 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:26 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" returned: 0 in 0.267s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.504s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4de12-11a1-40eb-8de8-7d0be6b583f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a29b97-2b3f-4346-8aed-6560069ccce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Creating offline snapshot 459d28b7-faa0-4910-ae40-54427d4d9453 of volume 32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:20:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Volume volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f (f025a0ea-9b05-40f5-98a5-d8c56cdc111f): created successfully Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a29b97-2b3f-4346-8aed-6560069ccce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (605b31be-729b-4b5e-9a36-9619f582db9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425a30a-7fba-44c0-99c3-81dcabefdb64]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6c3b7fe6-66e8-4e3b-baec-180015bc268d tempest-VolumesListAdminTestJSON-1925909097 None] Created volume successfully. Jul 17 14:20:27 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:27 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:27 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.482s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32aab065-05b2-44a4-a936-281c1b69aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:27 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 1G Jul 17 14:20:27 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:27 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 1G" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:27 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 Jul 17 14:20:27 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:28 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453" returned: 0 in 0.400s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:28 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 is being set with open permissions: ugo+rw Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:28 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 Jul 17 14:20:28 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (83074990-3eca-4aa4-a651-1195655b02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ade5fc-7b9a-4d21-a9c6-f612b3cd2a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ade5fc-7b9a-4d21-a9c6-f612b3cd2a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661904320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958e3d3a-82d7-4a28-8cf6-9cd5e67d498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:28Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81edd193-ff55-4190-90e1-a0a72d791137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81edd193-ff55-4190-90e1-a0a72d791137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcd7011-fa73-496c-9839-a52bf1f78584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcd7011-fa73-496c-9839-a52bf1f78584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958e3d3a-82d7-4a28-8cf6-9cd5e67d498d', 'volume_name': 'volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0ca16f-6f37-417f-b361-49154add65b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0ca16f-6f37-417f-b361-49154add65b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a87a6d-af5e-4396-9ff8-832f713ec60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:28 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Volume 958e3d3a-82d7-4a28-8cf6-9cd5e67d498d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d', 'volume_size': 1} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:28 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661904320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958e3d3a-82d7-4a28-8cf6-9cd5e67d498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:28Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Creating volume 958e3d3a-82d7-4a28-8cf6-9cd5e67d498d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:28 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d 1073741824 Jul 17 14:20:28 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7ef734c0-71a4-4b34-a2a0-97e928eb0768 tempest-VolumesDeleteCascade-2071272686 None] Create snapshot completed successfully Jul 17 14:20:29 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d 1073741824" returned: 0 in 0.489s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:29 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d Jul 17 14:20:29 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:29 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a87a6d-af5e-4396-9ff8-832f713ec60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a0497-a1fd-4a9d-b138-7f9889bfa767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Volume volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d (958e3d3a-82d7-4a28-8cf6-9cd5e67d498d): created successfully Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a0497-a1fd-4a9d-b138-7f9889bfa767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (83074990-3eca-4aa4-a651-1195655b02ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-32aab065-05b2-44a4-a936-281c1b69aaac-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5b6f3472-a6d3-4029-96e9-60e4d7867675 tempest-VolumesListAdminTestJSON-1925909097 None] Created volume successfully. Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-32aab065-05b2-44a4-a936-281c1b69aaac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Performing cascade delete. {{(pid=87804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-459d28b7-faa0-4910-ae40-54427d4d9453-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-459d28b7-faa0-4910-ae40-54427d4d9453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-459d28b7-faa0-4910-ae40-54427d4d9453" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-459d28b7-faa0-4910-ae40-54427d4d9453" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Deleting offline snapshot 459d28b7-faa0-4910-ae40-54427d4d9453 of volume 32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] snapshot_file for this snap is: volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c7d57-ae4e-4e73-aa70-b6712dd9b078]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:29 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 Jul 17 14:20:29 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:30 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453" returned: 0 in 0.398s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32aab065-05b2-44a4-a936-281c1b69aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91679d-71ed-45dd-8cff-a3e3605b0d11]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:30 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:30 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:30 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.614s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32aab065-05b2-44a4-a936-281c1b69aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:30 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 Jul 17 14:20:30 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (bbb873ed-7a2a-439d-8b45-c90ed6c22cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01577644-5a5b-453e-8f86-d6584d50ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01577644-5a5b-453e-8f86-d6584d50ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1356630968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f448a9b9-f51b-48b8-9aba-d1a6aa282103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:31Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58fc2e-21fd-4ba9-b96b-192abce87634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58fc2e-21fd-4ba9-b96b-192abce87634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75015e29-f4a6-44d8-a0b2-3a75cf322ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75015e29-f4a6-44d8-a0b2-3a75cf322ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f448a9b9-f51b-48b8-9aba-d1a6aa282103', 'volume_name': 'volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b210fd-bc45-4ed7-b061-fe3c986fb304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b210fd-bc45-4ed7-b061-fe3c986fb304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73043f67-cac3-46a9-9856-f01327475bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Volume f448a9b9-f51b-48b8-9aba-d1a6aa282103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103', 'volume_size': 1} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1356630968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f448a9b9-f51b-48b8-9aba-d1a6aa282103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3625f3920cd84831b69314818f6656de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:31Z,use_quota=True,user_id='3648feeee3c34c099e5306a2d265c2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Creating volume f448a9b9-f51b-48b8-9aba-d1a6aa282103 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:31 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:31 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 1073741824 Jul 17 14:20:31 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:31 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453" returned: 0 in 0.614s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:31 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453 Jul 17 14:20:31 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:31 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.459d28b7-faa0-4910-ae40-54427d4d9453" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-459d28b7-faa0-4910-ae40-54427d4d9453" released by "_delete_snapshot" :: held 2.051s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" released by "delete_snapshot" :: held 2.079s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['0ffd418c-1839-49b1-a2f7-2fe55431b00a', '4c368ee1-7880-407f-bb65-b51af8b1b614', 'b827d920-b8c5-4177-9ac6-127bf935ef81', '5a70fa98-40cd-4575-b51d-f5fc47a10665'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:31 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 1073741824" returned: 0 in 0.562s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Delete snapshot completed successfully. Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-459d28b7-faa0-4910-ae40-54427d4d9453-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-c593b73d-df28-492b-b122-912e298725f9-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-c593b73d-df28-492b-b122-912e298725f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:32 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 Jul 17 14:20:32 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-c593b73d-df28-492b-b122-912e298725f9" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-c593b73d-df28-492b-b122-912e298725f9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Deleting offline snapshot c593b73d-df28-492b-b122-912e298725f9 of volume 32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] snapshot_file for this snap is: volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b141989b-491d-4e61-97fc-279b33a82901]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:32 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:32 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:32 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73043f67-cac3-46a9-9856-f01327475bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98cea41-f4cb-4923-abdd-35693530ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Volume volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 (f448a9b9-f51b-48b8-9aba-d1a6aa282103): created successfully Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98cea41-f4cb-4923-abdd-35693530ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Flow 'volume_create_manager' (bbb873ed-7a2a-439d-8b45-c90ed6c22cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-45f993ac-8a65-4a54-afe3-9613f36d4c09 tempest-VolumesListAdminTestJSON-1925909097 None] Created volume successfully. Jul 17 14:20:32 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.493s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32aab065-05b2-44a4-a936-281c1b69aaac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c87f20-3e60-4efc-a29a-3fe977436cbb]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:32 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac Jul 17 14:20:32 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:33 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac" returned: 0 in 0.607s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:33 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:33 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:33 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.549s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:33 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9 Jul 17 14:20:33 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:34 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac.c593b73d-df28-492b-b122-912e298725f9" returned: 0 in 0.488s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-c593b73d-df28-492b-b122-912e298725f9" released by "_delete_snapshot" :: held 2.279s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" released by "delete_snapshot" :: held 2.310s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['391fb68b-b214-49f8-9cc1-8861862af655', 'a1226c8f-1021-4f34-9594-33c5ad2d7619', '6d807242-def4-4531-adf4-c992899d6180', '792b4e2e-9aba-4249-930f-47034572f094'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Flow 'volume_create_manager' (d4078061-73db-4734-9685-1aa37ee57426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9347079e-f36c-49e1-a6c0-0070696296e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9347079e-f36c-49e1-a6c0-0070696296e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e57d49b-be61-4cc8-95b7-af2b9a3a4825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fae69d68748fb8fe00b6c738ad85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:34Z,use_quota=True,user_id='de2703f5498a46fcb63da5559118b441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27308b5-a195-4c88-9b32-ad75eeae8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27308b5-a195-4c88-9b32-ad75eeae8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff365ed8-d996-45da-8c63-5b497a4b3b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff365ed8-d996-45da-8c63-5b497a4b3b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e57d49b-be61-4cc8-95b7-af2b9a3a4825', 'volume_name': 'volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8f089f-9933-471c-a46f-5b8c7738ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8f089f-9933-471c-a46f-5b8c7738ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe652c5-77b7-4e0b-a9d6-d4884c6a1088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:34 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Volume 1e57d49b-be61-4cc8-95b7-af2b9a3a4825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825', 'volume_size': 1} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e57d49b-be61-4cc8-95b7-af2b9a3a4825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fae69d68748fb8fe00b6c738ad85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:34Z,use_quota=True,user_id='de2703f5498a46fcb63da5559118b441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Creating volume 1e57d49b-be61-4cc8-95b7-af2b9a3a4825 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:34 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Delete snapshot completed successfully. Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-c593b73d-df28-492b-b122-912e298725f9-delete_snapshot" released by "delete_snapshot" :: held 2.723s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Snapshots deleted, issuing volume delete {{(pid=87804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:34 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 1073741824 Jul 17 14:20:34 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbcf7a9-815b-4882-b764-0f542f41a5e9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:34 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac Jul 17 14:20:34 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:35 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 1073741824" returned: 0 in 0.658s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:35 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac" returned: 0 in 0.610s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:35 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac Jul 17 14:20:35 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:35 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 Jul 17 14:20:35 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:35 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:35 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-32aab065-05b2-44a4-a936-281c1b69aaac" returned: 0 in 0.378s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe652c5-77b7-4e0b-a9d6-d4884c6a1088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baa102e-5323-45b5-9a08-7ed34f0b622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-32aab065-05b2-44a4-a936-281c1b69aaac" released by "delete_volume" :: held 1.077s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:35 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Volume volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 (1e57d49b-be61-4cc8-95b7-af2b9a3a4825): created successfully Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baa102e-5323-45b5-9a08-7ed34f0b622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Flow 'volume_create_manager' (d4078061-73db-4734-9685-1aa37ee57426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0249e49f-9f68-4cbf-ab2b-e435235b7afc tempest-VolumesListAdminTestJSON-1890450746 None] Created volume successfully. Jul 17 14:20:35 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['f61288f3-a7bf-48c0-b417-6c55d8673ef5', '47807d3d-6ff1-4fdb-ab71-19d88bb810da', '9e362f5b-a406-423e-b02a-cd14d4d4e6cb', 'cedcbeb5-b74d-41e9-860f-1919e453c53a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:36 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:36 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:36 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.303s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Deleted volume successfully. Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1a72b161-c504-4921-a55c-caf83c69b154 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-32aab065-05b2-44a4-a936-281c1b69aaac-delete_volume" released by "delete_volume" :: held 6.761s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Acquiring lock "cinder-1e57d49b-be61-4cc8-95b7-af2b9a3a4825-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "cinder-1e57d49b-be61-4cc8-95b7-af2b9a3a4825-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Acquiring lock "cinder-quobyte-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "cinder-quobyte-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-f448a9b9-f51b-48b8-9aba-d1a6aa282103-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d3475-205b-446d-8166-258f727db754]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-f448a9b9-f51b-48b8-9aba-d1a6aa282103-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-quobyte-f448a9b9-f51b-48b8-9aba-d1a6aa282103" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-f448a9b9-f51b-48b8-9aba-d1a6aa282103" acquired by "delete_volume" :: waited 0.037s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:37 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 Jul 17 14:20:37 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc161c7-2c41-4f93-9d44-12c04a392c24]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (9baf058b-a22d-4376-aac8-0b0663a51c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4891b-03ab-44c9-9e54-cc0e5ca18c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:37 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 Jul 17 14:20:37 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4891b-03ab-44c9-9e54-cc0e5ca18c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1144897709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87201f24-07a8-47d1-a27d-9a26eac94df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b901b03eeaaa4a85bb45cd3c040617e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:37Z,use_quota=True,user_id='b476316df2fb4d2f8a2619c234ecd5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1152ac4-b576-4c87-93a3-2523731f00f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1152ac4-b576-4c87-93a3-2523731f00f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7f144-35ab-47f3-b7d6-fcb882fa184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7f144-35ab-47f3-b7d6-fcb882fa184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87201f24-07a8-47d1-a27d-9a26eac94df9', 'volume_name': 'volume-87201f24-07a8-47d1-a27d-9a26eac94df9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822731b3-148a-4be4-9827-35f8e3ef2ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822731b3-148a-4be4-9827-35f8e3ef2ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674f4350-920c-49fb-b9a9-2ab569d5cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Volume 87201f24-07a8-47d1-a27d-9a26eac94df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87201f24-07a8-47d1-a27d-9a26eac94df9', 'volume_size': 1} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1144897709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87201f24-07a8-47d1-a27d-9a26eac94df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b901b03eeaaa4a85bb45cd3c040617e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:37Z,use_quota=True,user_id='b476316df2fb4d2f8a2619c234ecd5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Creating volume 87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:37 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:37 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 1073741824 Jul 17 14:20:37 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:37 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" returned: 0 in 0.647s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:37 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825 Jul 17 14:20:37 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:37 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103" returned: 0 in 0.525s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:37 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103 Jul 17 14:20:37 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:38 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f448a9b9-f51b-48b8-9aba-d1a6aa282103" returned: 0 in 0.330s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-f448a9b9-f51b-48b8-9aba-d1a6aa282103" released by "delete_volume" :: held 0.941s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:38 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" returned: 0 in 0.519s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "cinder-quobyte-1e57d49b-be61-4cc8-95b7-af2b9a3a4825" released by "delete_volume" :: held 1.259s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Created reservations ['1d2d8666-e9b8-4228-809a-38293befe65d', '7f11e28b-9ddd-4dd0-8145-7bc9562d1668', 'caa60647-cb52-49a2-9040-0ae43d7a46d0', '7b37976f-5465-4753-87ed-bebacf50a3c5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:38 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 1073741824" returned: 0 in 0.810s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Created reservations ['491026a2-f279-47fe-b359-8be870be32d7', 'c3138085-1815-4e92-9c5b-3031236eb5fd', 'c6b96ed0-63ff-401d-9d55-4898b406963c', '595a71e7-fb91-460c-9fdc-439771c60b6a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:38 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:38 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:38 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:38 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:38 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:38 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:38 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674f4350-920c-49fb-b9a9-2ab569d5cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87201f24-07a8-47d1-a27d-9a26eac94df9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9785de-53f7-4d75-8ab3-059be6ffd2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:38 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Volume volume-87201f24-07a8-47d1-a27d-9a26eac94df9 (87201f24-07a8-47d1-a27d-9a26eac94df9): created successfully Jul 17 14:20:38 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9785de-53f7-4d75-8ab3-059be6ffd2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:38 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (9baf058b-a22d-4376-aac8-0b0663a51c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.437s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.372s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Deleted volume successfully. Jul 17 14:20:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-06622b5f-bd4b-4849-909a-0f2b15b2519d tempest-VolumesDeleteCascade-2071272686 None] Created volume successfully. Jul 17 14:20:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c2b993ab-3eab-4f92-95a9-196f8ae475dc tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-f448a9b9-f51b-48b8-9aba-d1a6aa282103-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Deleted volume successfully. Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41363b41-ccd1-4be1-917e-e2e7426c95ac tempest-VolumesListAdminTestJSON-1890450746 None] Lock "cinder-1e57d49b-be61-4cc8-95b7-af2b9a3a4825-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-quobyte-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf9e00-0bea-4d04-ae5d-db5bbb92e953]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Creating offline snapshot 1c2099df-2db7-49f0-a937-8c36d775f6ad of volume 87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bfe83-c419-4e24-b407-bd25211b4095]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:39 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d Jul 17 14:20:39 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:39 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:39 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:40 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" returned: 0 in 0.511s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:40 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d Jul 17 14:20:40 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:40 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.522s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:40 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad 1G Jul 17 14:20:40 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:40 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" returned: 0 in 0.370s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d" released by "delete_volume" :: held 0.949s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Created reservations ['58ec58aa-3ae9-4273-b50c-22b13aeb9325', '830b2fb9-87ae-4a39-9615-d74d6415b238', 'ee4e856d-e0c4-4eee-a468-cc8b6ee3e968', '6329934e-639c-4e26-8221-cc14d7d19ec1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:40 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:40 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:40 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad 1G" returned: 0 in 0.652s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87201f24-07a8-47d1-a27d-9a26eac94df9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:41 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87201f24-07a8-47d1-a27d-9a26eac94df9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:41 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:41 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Deleted volume successfully. Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ea4604c-e532-477e-863b-e97a79f22a74 tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-958e3d3a-82d7-4a28-8cf6-9cd5e67d498d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:41 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87201f24-07a8-47d1-a27d-9a26eac94df9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:41 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad is being set with open permissions: ugo+rw Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:41 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:41 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:41 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.321s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:41 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info Jul 17 14:20:41 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-f025a0ea-9b05-40f5-98a5-d8c56cdc111f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-f025a0ea-9b05-40f5-98a5-d8c56cdc111f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "cinder-quobyte-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f88e8-cd0f-4f35-b084-89bab85da42c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:42 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info" returned: 0 in 0.465s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:42 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info is being set with open permissions: ugo+rw Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:42 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info Jul 17 14:20:42 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:42 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f Jul 17 14:20:42 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:42 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.info" returned: 0 in 0.497s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c8ef4d77-d0c9-4a9b-aeb5-30031d7e0bd1 tempest-VolumesDeleteCascade-2071272686 None] Create snapshot completed successfully Jul 17 14:20:42 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" returned: 0 in 0.715s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:42 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f Jul 17 14:20:42 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:43 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" returned: 0 in 0.568s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-quobyte-f025a0ea-9b05-40f5-98a5-d8c56cdc111f" released by "delete_volume" :: held 1.384s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Created reservations ['971c5960-fb3d-4399-bb70-25d360561558', '9f62efcf-6906-41d6-93f6-901b0e75fdb8', '9770d641-9fea-4623-adcd-4b513e619bbf', 'f499c189-8e4c-4caa-b279-9ee8303df926'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:43 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:43 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:43 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (5b88a0c3-4b22-49c6-b63a-2eee6fdef620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc5ff93-0d0c-459a-9e06-66282b1d7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc5ff93-0d0c-459a-9e06-66282b1d7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-809123507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d523d1fe-ade6-48a5-b995-6cd90faeebb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b901b03eeaaa4a85bb45cd3c040617e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c2099df-2db7-49f0-a937-8c36d775f6ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:20:44Z,use_quota=True,user_id='b476316df2fb4d2f8a2619c234ecd5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df2a50-a61c-4013-8ce5-4000f1b4312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df2a50-a61c-4013-8ce5-4000f1b4312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f484cf2-d2c6-47f0-bb8b-59b14e59eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f484cf2-d2c6-47f0-bb8b-59b14e59eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd523d1fe-ade6-48a5-b995-6cd90faeebb0', 'volume_name': 'volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0', 'volume_size': 1, 'snapshot_id': '1c2099df-2db7-49f0-a937-8c36d775f6ad'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56668615-5a1a-42b4-922b-65c33532439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56668615-5a1a-42b4-922b-65c33532439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08c82e-b4ac-4bf0-b1cd-fd30a7b2708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Volume d523d1fe-ade6-48a5-b995-6cd90faeebb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0', 'volume_size': 1, 'snapshot_id': '1c2099df-2db7-49f0-a937-8c36d775f6ad'} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad-d523d1fe-ade6-48a5-b995-6cd90faeebb0" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad-d523d1fe-ade6-48a5-b995-6cd90faeebb0" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Creating volume d523d1fe-ade6-48a5-b995-6cd90faeebb0 from snapshot 1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:44 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.471s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Deleted volume successfully. Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] snapshot: 1c2099df-2db7-49f0-a937-8c36d775f6ad, volume: d523d1fe-ade6-48a5-b995-6cd90faeebb0, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d41c9c3c-98e3-49ee-94e8-464adf18063a tempest-VolumesListAdminTestJSON-1925909097 None] Lock "cinder-f025a0ea-9b05-40f5-98a5-d8c56cdc111f-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[02188200-542a-44d3-8735-b8eea9a13e1a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:44 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:44 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:44 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.561s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87201f24-07a8-47d1-a27d-9a26eac94df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c02f13-cb00-4b7d-9f45-abe875ccf948]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:45 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:45 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:45 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.538s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:45 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:20:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:45 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 Jul 17 14:20:45 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:51 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0" returned: 0 in 5.764s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8f2778-8106-44ad-8223-9805f11332d4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:51 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:51 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:52 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.807s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:20:52 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Converted 1024.00 MB image at 177.61 MB/s Jul 17 14:20:52 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 is being set with open permissions: ugo+rw Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:52 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 Jul 17 14:20:52 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:52 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" released by "_copy_volume_from_snapshot" :: held 8.206s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad-d523d1fe-ade6-48a5-b995-6cd90faeebb0" released by "_create_volume_from_snapshot" :: held 8.287s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.318s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=96,cinder:UPDATE=118,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=110,cinder:UPDATE=128,cinder:INSERT=28,cinder:DELETE=13 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08c82e-b4ac-4bf0-b1cd-fd30a7b2708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0', 'volume_size': 1, 'snapshot_id': '1c2099df-2db7-49f0-a937-8c36d775f6ad'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad427d4-2ec9-47ab-a3d6-66c2b7b18b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:20:52 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Volume volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 (d523d1fe-ade6-48a5-b995-6cd90faeebb0): created successfully Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad427d4-2ec9-47ab-a3d6-66c2b7b18b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:20:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Flow 'volume_create_manager' (5b88a0c3-4b22-49c6-b63a-2eee6fdef620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:20:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7534f168-53d3-4025-a82e-04723c9fd245 tempest-VolumesDeleteCascade-2071272686 None] Created volume successfully. Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-87201f24-07a8-47d1-a27d-9a26eac94df9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-87201f24-07a8-47d1-a27d-9a26eac94df9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Performing cascade delete. {{(pid=87804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-1c2099df-2db7-49f0-a937-8c36d775f6ad-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-1c2099df-2db7-49f0-a937-8c36d775f6ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Deleting offline snapshot 1c2099df-2db7-49f0-a937-8c36d775f6ad of volume 87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] snapshot_file for this snap is: volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff83b52-0448-44e2-8f86-e878b553739a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:53 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:53 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:53 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.465s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87201f24-07a8-47d1-a27d-9a26eac94df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:20:54 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe0ac5-cf19-44f9-ada8-0f900514f85d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:54 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:54 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:54 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.496s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:54 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:54 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:55 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.514s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:55 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad Jul 17 14:20:55 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:55 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9.1c2099df-2db7-49f0-a937-8c36d775f6ad" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-1c2099df-2db7-49f0-a937-8c36d775f6ad" released by "_delete_snapshot" :: held 1.972s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" released by "delete_snapshot" :: held 2.013s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['a5ae401d-e5ec-4eb1-bb10-ec3b114ace41', '7e9a7262-3943-42a6-987d-f088d602dd0d', 'd778d80f-96be-46f0-b085-93cb40fe2b19', '289bb6bb-effa-4ea3-9284-745f7239f7db'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Delete snapshot completed successfully. Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-1c2099df-2db7-49f0-a937-8c36d775f6ad-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Snapshots deleted, issuing volume delete {{(pid=87804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e7111f-8741-42e3-8ce6-d89004112894]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:56 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:56 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:56 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.825s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:56 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9 Jul 17 14:20:56 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:57 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-87201f24-07a8-47d1-a27d-9a26eac94df9" returned: 0 in 0.648s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-87201f24-07a8-47d1-a27d-9a26eac94df9" released by "delete_volume" :: held 1.647s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['1cac77cb-baea-455c-9444-ff8f4d109ac7', '0a17b154-cb92-44e3-bdea-dc22b102c701', '941ae6f6-96f7-43ca-b4c2-350382947c31', '539b77e7-ccfa-4315-a7cf-77c4c9dbed3f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:20:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:57 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:20:57 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:58 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.781s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:20:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Deleted volume successfully. Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-d523d1fe-ade6-48a5-b995-6cd90faeebb0-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-d523d1fe-ade6-48a5-b995-6cd90faeebb0-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6a835c15-5201-4d3b-bb85-431f21080c4d tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-87201f24-07a8-47d1-a27d-9a26eac94df9-delete_volume" released by "delete_volume" :: held 5.440s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb282b8-2603-4e06-8c9c-6dd413793381]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:20:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:59 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 Jul 17 14:20:59 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:20:59 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 17 14:20:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0" returned: 0 in 0.750s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:20:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:20:59 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0 Jul 17 14:20:59 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:00 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d523d1fe-ade6-48a5-b995-6cd90faeebb0" returned: 0 in 0.622s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-quobyte-d523d1fe-ade6-48a5-b995-6cd90faeebb0" released by "delete_volume" :: held 1.467s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Created reservations ['8b403a04-df7d-44d9-aca7-7e254e67161c', '1dc0dc63-377a-4fc6-80c2-fbf45eac5643', '9d3e07a9-3c68-4a6a-9566-28c6f18847f1', '2337a632-1fdb-4acd-b00a-d1f182fefa7d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:00 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:00 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:00 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Deleted volume successfully. Jul 17 14:21:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f848b091-3d0c-4e90-ac98-dfa333451d39 tempest-VolumesDeleteCascade-2071272686 None] Lock "cinder-d523d1fe-ade6-48a5-b995-6cd90faeebb0-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Flow 'volume_create_manager' (d363adc0-4dcb-4348-9c0a-9eb13a81b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4495ece-be69-4446-be9a-9e468625171a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4495ece-be69-4446-be9a-9e468625171a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1783755606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7046b2bf-8839-4cbc-b12a-1e251eba2fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572a54142c945f09cda6d27d655d0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:07Z,use_quota=True,user_id='3a220d069c2448a8828f3e1a1c017073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96df0f31-1504-4116-af0e-a523a0dabbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96df0f31-1504-4116-af0e-a523a0dabbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc8145-1cad-4ae9-b163-01c51506e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc8145-1cad-4ae9-b163-01c51506e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7046b2bf-8839-4cbc-b12a-1e251eba2fab', 'volume_name': 'volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f80ae35-f700-43b5-a3a1-298e230cf45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f80ae35-f700-43b5-a3a1-298e230cf45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45664b6-ada3-4131-8189-600dcdfd8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Volume 7046b2bf-8839-4cbc-b12a-1e251eba2fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab', 'volume_size': 1} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1783755606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7046b2bf-8839-4cbc-b12a-1e251eba2fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572a54142c945f09cda6d27d655d0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:07Z,use_quota=True,user_id='3a220d069c2448a8828f3e1a1c017073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Creating volume 7046b2bf-8839-4cbc-b12a-1e251eba2fab {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:07 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:07 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab 1073741824 Jul 17 14:21:07 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:08 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab 1073741824" returned: 0 in 0.739s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:08 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab Jul 17 14:21:08 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:08 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab" returned: 0 in 0.363s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45664b6-ada3-4131-8189-600dcdfd8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676ab30-88e8-47be-84fe-7984aca18fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Volume volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab (7046b2bf-8839-4cbc-b12a-1e251eba2fab): created successfully Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676ab30-88e8-47be-84fe-7984aca18fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Flow 'volume_create_manager' (d363adc0-4dcb-4348-9c0a-9eb13a81b287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0c841260-fb12-4290-8475-7b2435bef2af tempest-VolumesMetadataTest-574928173 None] Created volume successfully. Jul 17 14:21:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Flow 'volume_create_manager' (33ac31da-9091-4e4b-bcbf-d723eca4ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6262bf10-1940-4a83-bc2a-a329b36c1e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6262bf10-1940-4a83-bc2a-a329b36c1e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-658403102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0831c764-544c-4083-a2ad-993bf1bd169b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53064a87ecd44ac7bd050748ad4ec029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:10Z,use_quota=True,user_id='9f5ed7c64e8f4e49a6c563e5430260fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9244a42-3188-403c-b6b6-5d6f95d6ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9244a42-3188-403c-b6b6-5d6f95d6ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d7768-bcc4-4579-9795-bfc77f99ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d7768-bcc4-4579-9795-bfc77f99ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0831c764-544c-4083-a2ad-993bf1bd169b', 'volume_name': 'volume-0831c764-544c-4083-a2ad-993bf1bd169b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6baba391-7bfe-40d6-94e9-91c3c8e8f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6baba391-7bfe-40d6-94e9-91c3c8e8f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd49bc-cfaa-4649-b094-e963ee63a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:10 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Volume 0831c764-544c-4083-a2ad-993bf1bd169b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0831c764-544c-4083-a2ad-993bf1bd169b', 'volume_size': 1} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-658403102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0831c764-544c-4083-a2ad-993bf1bd169b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53064a87ecd44ac7bd050748ad4ec029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:10Z,use_quota=True,user_id='9f5ed7c64e8f4e49a6c563e5430260fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Creating volume 0831c764-544c-4083-a2ad-993bf1bd169b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:10 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b 1073741824 Jul 17 14:21:10 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Acquiring lock "cinder-7046b2bf-8839-4cbc-b12a-1e251eba2fab-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "cinder-7046b2bf-8839-4cbc-b12a-1e251eba2fab-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Acquiring lock "cinder-quobyte-7046b2bf-8839-4cbc-b12a-1e251eba2fab" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "cinder-quobyte-7046b2bf-8839-4cbc-b12a-1e251eba2fab" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc15a8-1858-44e5-932d-0bf75015711e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:10 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab Jul 17 14:21:10 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:10 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b 1073741824" returned: 0 in 0.878s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:11 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b Jul 17 14:21:11 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:11 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab" returned: 0 in 0.617s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:11 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab Jul 17 14:21:11 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:11 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b" returned: 0 in 0.306s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd49bc-cfaa-4649-b094-e963ee63a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0831c764-544c-4083-a2ad-993bf1bd169b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a88217-768a-49e4-82ea-3751a7603f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Volume volume-0831c764-544c-4083-a2ad-993bf1bd169b (0831c764-544c-4083-a2ad-993bf1bd169b): created successfully Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a88217-768a-49e4-82ea-3751a7603f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Flow 'volume_create_manager' (33ac31da-9091-4e4b-bcbf-d723eca4ab53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-daeb94a0-a936-44e3-b20f-4ecbe3a1fce4 tempest-VolumesTransfersTest-101331996 None] Created volume successfully. Jul 17 14:21:11 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7046b2bf-8839-4cbc-b12a-1e251eba2fab" returned: 0 in 0.292s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "cinder-quobyte-7046b2bf-8839-4cbc-b12a-1e251eba2fab" released by "delete_volume" :: held 0.964s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Created reservations ['2d98468e-01bc-4911-8395-1b7564c1869e', 'fe77dad4-e705-441e-b529-cfc001acd1a2', '4abc5d17-8dc0-4f15-a146-4a52682cc630', '6ca8c035-95b5-4781-a787-3cf346e66e83'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:11 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:11 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:11 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.259s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Deleted volume successfully. Jul 17 14:21:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-30fb44b2-0c0f-42df-a955-6de5198df45f tempest-VolumesMetadataTest-574928173 None] Lock "cinder-7046b2bf-8839-4cbc-b12a-1e251eba2fab-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-104297c6-5c8e-47cd-92f7-e0cbeebc06da tempest-VolumesTransfersTest-2105793285 None] Transfer volume completed successfully. Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "cinder-0831c764-544c-4083-a2ad-993bf1bd169b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-0831c764-544c-4083-a2ad-993bf1bd169b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "cinder-quobyte-0831c764-544c-4083-a2ad-993bf1bd169b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-quobyte-0831c764-544c-4083-a2ad-993bf1bd169b" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803fee1-5966-4911-a780-5457dd208aba]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:13 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b Jul 17 14:21:13 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:14 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b" returned: 0 in 0.619s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:14 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b Jul 17 14:21:14 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:14 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0831c764-544c-4083-a2ad-993bf1bd169b" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-quobyte-0831c764-544c-4083-a2ad-993bf1bd169b" released by "delete_volume" :: held 1.089s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:14 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Created reservations ['84bd2655-ea3d-4636-8258-ed680633e1b2', '82e8146c-0e7d-46d3-90ac-a423accea0e9', 'b15f83eb-e72b-40ce-8ff5-b70d4b1f7817', '827405dd-a0be-4456-9ad2-2d07083a9066'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:15 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:15 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:15 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Deleted volume successfully. Jul 17 14:21:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7dd48380-7f46-4d05-a0fc-4c9764b94f76 tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-0831c764-544c-4083-a2ad-993bf1bd169b-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Flow 'volume_create_manager' (4139a474-bbbd-464b-9010-892086f81d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fea401-bdb6-481e-98b7-78023d806133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fea401-bdb6-481e-98b7-78023d806133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-394510225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444682b9-6b3a-4f00-86b5-2c9527f8c8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53064a87ecd44ac7bd050748ad4ec029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:17Z,use_quota=True,user_id='9f5ed7c64e8f4e49a6c563e5430260fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f30a8d-abb9-46f9-aa3b-dc8918ec231e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f30a8d-abb9-46f9-aa3b-dc8918ec231e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dd6070-5778-4a15-9cac-5c1aba56b76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dd6070-5778-4a15-9cac-5c1aba56b76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444682b9-6b3a-4f00-86b5-2c9527f8c8e2', 'volume_name': 'volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d363bb38-ba0e-4cbb-a2d1-e6ea61136235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d363bb38-ba0e-4cbb-a2d1-e6ea61136235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a0b8f-b796-4cae-b5c7-897843057378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Volume 444682b9-6b3a-4f00-86b5-2c9527f8c8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2', 'volume_size': 1} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-394510225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444682b9-6b3a-4f00-86b5-2c9527f8c8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53064a87ecd44ac7bd050748ad4ec029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:17Z,use_quota=True,user_id='9f5ed7c64e8f4e49a6c563e5430260fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Creating volume 444682b9-6b3a-4f00-86b5-2c9527f8c8e2 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:16 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 1073741824 Jul 17 14:21:16 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:17 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 1073741824" returned: 0 in 0.611s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:17 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 Jul 17 14:21:17 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:17 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a0b8f-b796-4cae-b5c7-897843057378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a7bef-7e72-4ed1-a9c0-b2d986369a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Volume volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 (444682b9-6b3a-4f00-86b5-2c9527f8c8e2): created successfully Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a7bef-7e72-4ed1-a9c0-b2d986369a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Flow 'volume_create_manager' (4139a474-bbbd-464b-9010-892086f81d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ea2014f6-ebea-4235-94d9-e9f902e1fd58 tempest-VolumesTransfersTest-101331996 None] Created volume successfully. Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "cinder-444682b9-6b3a-4f00-86b5-2c9527f8c8e2-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-444682b9-6b3a-4f00-86b5-2c9527f8c8e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "cinder-quobyte-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-quobyte-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7ff63c-0f68-45f8-874c-df9dc30a196f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:19 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 Jul 17 14:21:19 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:19 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" returned: 0 in 0.485s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:19 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2 Jul 17 14:21:19 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:20 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-quobyte-444682b9-6b3a-4f00-86b5-2c9527f8c8e2" released by "delete_volume" :: held 0.809s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Created reservations ['22380140-573b-4f77-a859-d1ef0e1d2fe3', '584f0a3d-4c02-4781-9c06-4446d1dc7064', 'c08d87b3-7383-4e89-9250-8c76dfdc9502', '96a71867-a897-4e3b-ab21-5bf8951695f5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:20 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:20 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:20 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Deleted volume successfully. Jul 17 14:21:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0e52f0be-8d19-47e4-8b11-8f03ba8a872d tempest-VolumesTransfersTest-1462191184 None] Lock "cinder-444682b9-6b3a-4f00-86b5-2c9527f8c8e2-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (a5e107dd-d835-4b13-a581-7588fb7e6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b3bdee-c2c0-40fa-8a2f-9dce05e21e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b3bdee-c2c0-40fa-8a2f-9dce05e21e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-882305977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a673a6f-e267-4c24-b114-bfb5eaa4cefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:23Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2af885-bc47-4148-b054-07ebec1bef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2af885-bc47-4148-b054-07ebec1bef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a755b52-c849-418c-a345-e4d0a98da548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a755b52-c849-418c-a345-e4d0a98da548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a673a6f-e267-4c24-b114-bfb5eaa4cefa', 'volume_name': 'volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ffbe91-14b4-4433-884c-2403c6e272cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ffbe91-14b4-4433-884c-2403c6e272cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdf915e-e7ca-4c31-b4cd-9554970857dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:23 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Volume 2a673a6f-e267-4c24-b114-bfb5eaa4cefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa', 'volume_size': 1} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-882305977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a673a6f-e267-4c24-b114-bfb5eaa4cefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:23Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Creating volume 2a673a6f-e267-4c24-b114-bfb5eaa4cefa {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:23 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:23 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa 1073741824 Jul 17 14:21:23 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:24 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa 1073741824" returned: 0 in 1.103s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:24 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa Jul 17 14:21:24 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:25 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" returned: 0 in 0.613s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdf915e-e7ca-4c31-b4cd-9554970857dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109e9577-a7d6-4f94-a0fa-b74ff4924b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:25 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Volume volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa (2a673a6f-e267-4c24-b114-bfb5eaa4cefa): created successfully Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109e9577-a7d6-4f94-a0fa-b74ff4924b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (a5e107dd-d835-4b13-a581-7588fb7e6079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-880886ea-253c-4b5a-adb4-ae01cc616308 tempest-AttachVolumeTestJSON-431579605 None] Created volume successfully. Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:25 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:25 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:26 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.416s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:21:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:21:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:21:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-31d26cba-1629-4a4f-8b39-09883f5f5fe3 req-7371b75b-40bd-408f-bcf7-76bba55f3a35 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-31d26cba-1629-4a4f-8b39-09883f5f5fe3 req-7371b75b-40bd-408f-bcf7-76bba55f3a35 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-31d26cba-1629-4a4f-8b39-09883f5f5fe3 req-7371b75b-40bd-408f-bcf7-76bba55f3a35 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-31d26cba-1629-4a4f-8b39-09883f5f5fe3 req-7371b75b-40bd-408f-bcf7-76bba55f3a35 tempest-AttachVolumeTestJSON-431579605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b9d4a7c-cfba-4247-aa96-4ae48d5d4aa3', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:21:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-31d26cba-1629-4a4f-8b39-09883f5f5fe3 req-7371b75b-40bd-408f-bcf7-76bba55f3a35 tempest-AttachVolumeTestJSON-431579605 None] attachment_update completed successfully. Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (c705cf55-5b28-4cf8-9dcf-e814b3b82b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58548110-b4d2-4bc2-ac96-c4a3b42f12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58548110-b4d2-4bc2-ac96-c4a3b42f12a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-129859400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e17acf-182f-4567-b632-c59f573c8265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:28Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db08280-0146-47b2-80cf-e7605cff86d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db08280-0146-47b2-80cf-e7605cff86d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42b5fff-0a71-43cc-9677-5ce6ec3fd906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42b5fff-0a71-43cc-9677-5ce6ec3fd906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e17acf-182f-4567-b632-c59f573c8265', 'volume_name': 'volume-42e17acf-182f-4567-b632-c59f573c8265', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c1f74-797f-40ac-b597-eae57f92b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c1f74-797f-40ac-b597-eae57f92b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28593a94-1b94-4738-a737-00a317fb1fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:28 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Volume 42e17acf-182f-4567-b632-c59f573c8265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e17acf-182f-4567-b632-c59f573c8265', 'volume_size': 1} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-129859400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e17acf-182f-4567-b632-c59f573c8265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:28Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Creating volume 42e17acf-182f-4567-b632-c59f573c8265 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:28 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 1073741824 Jul 17 14:21:28 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:29 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 1073741824" returned: 0 in 0.892s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:29 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 Jul 17 14:21:29 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:29 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265" returned: 0 in 0.383s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28593a94-1b94-4738-a737-00a317fb1fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e17acf-182f-4567-b632-c59f573c8265', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b64c3b-622d-4ab1-8f06-bfe4409381b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Volume volume-42e17acf-182f-4567-b632-c59f573c8265 (42e17acf-182f-4567-b632-c59f573c8265): created successfully Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b64c3b-622d-4ab1-8f06-bfe4409381b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (c705cf55-5b28-4cf8-9dcf-e814b3b82b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7c8e209c-96c6-4b7d-8a41-d61ea3bd09c0 tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:21:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9108ccb-27a0-4636-bec3-046ce9c1c175 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-42e17acf-182f-4567-b632-c59f573c8265" by "attach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9108ccb-27a0-4636-bec3-046ce9c1c175 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265" acquired by "attach_volume" :: waited 0.049s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c9108ccb-27a0-4636-bec3-046ce9c1c175 tempest-VolumesActionsTest-1308728964 None] Attaching volume 42e17acf-182f-4567-b632-c59f573c8265 to instance 25e2ac39-1969-48f1-96d6-942291adfcc5 at mountpoint /dev/vdb on host None. Jul 17 14:21:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c9108ccb-27a0-4636-bec3-046ce9c1c175 tempest-VolumesActionsTest-1308728964 None] Attach volume completed successfully. Jul 17 14:21:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9108ccb-27a0-4636-bec3-046ce9c1c175 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265" released by "attach_volume" :: held 0.293s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (42de8537-1dd2-4a33-b57c-133503d07cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ab02dc-c740-479a-bc5f-5ef79565d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ab02dc-c740-479a-bc5f-5ef79565d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028023760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e83df39-c92f-45a4-afce-03d97f93e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:32Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a68273-82b2-4835-90be-00553262ede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a68273-82b2-4835-90be-00553262ede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74730cb1-76e7-470d-a907-907d323ea3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74730cb1-76e7-470d-a907-907d323ea3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e83df39-c92f-45a4-afce-03d97f93e9da', 'volume_name': 'volume-8e83df39-c92f-45a4-afce-03d97f93e9da', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da553e6-41e3-4380-8a78-14cb36bdbc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da553e6-41e3-4380-8a78-14cb36bdbc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df7e196-e23d-468f-9eef-636d96cfce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Volume 8e83df39-c92f-45a4-afce-03d97f93e9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e83df39-c92f-45a4-afce-03d97f93e9da', 'volume_size': 1} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028023760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e83df39-c92f-45a4-afce-03d97f93e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12200456eb334f648a302b3b9f8c9d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:32Z,use_quota=True,user_id='7ca057db3f69457d9c40d25b953e1437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Creating volume 8e83df39-c92f-45a4-afce-03d97f93e9da {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:32 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da 1073741824 Jul 17 14:21:32 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Terminate volume connection completed successfully. Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" by "detach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Detaching volume 42e17acf-182f-4567-b632-c59f573c8265 from instance 25e2ac39-1969-48f1-96d6-942291adfcc5. Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Detach volume completed successfully. Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e59756a-6d33-404b-9a12-c509d84930c2 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ef2d2a2-912d-4282-8208-9abc2f8af632 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" by "detach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ef2d2a2-912d-4282-8208-9abc2f8af632 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2ef2d2a2-912d-4282-8208-9abc2f8af632 tempest-VolumesActionsTest-1308728964 None] Volume detach called, but volume not attached. Jul 17 14:21:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ef2d2a2-912d-4282-8208-9abc2f8af632 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:33 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da 1073741824" returned: 0 in 0.942s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:33 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da Jul 17 14:21:33 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-quobyte-42e17acf-182f-4567-b632-c59f573c8265" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-quobyte-42e17acf-182f-4567-b632-c59f573c8265" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a91e4d-5ed2-4086-ad97-c3c290525d92]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:33 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 Jul 17 14:21:33 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:33 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df7e196-e23d-468f-9eef-636d96cfce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e83df39-c92f-45a4-afce-03d97f93e9da', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d5241f-eebb-4a8d-919c-4d3fd8d443b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:33 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Volume volume-8e83df39-c92f-45a4-afce-03d97f93e9da (8e83df39-c92f-45a4-afce-03d97f93e9da): created successfully Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d5241f-eebb-4a8d-919c-4d3fd8d443b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Flow 'volume_create_manager' (42de8537-1dd2-4a33-b57c-133503d07cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7d696028-a097-41f4-a753-56eac3f355c5 tempest-AttachVolumeTestJSON-431579605 None] Created volume successfully. Jul 17 14:21:34 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265" returned: 0 in 0.711s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:34 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265 Jul 17 14:21:34 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:34 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-42e17acf-182f-4567-b632-c59f573c8265" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-quobyte-42e17acf-182f-4567-b632-c59f573c8265" released by "delete_volume" :: held 1.179s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Created reservations ['ea2144a2-ff77-408c-b802-e0fdd6ba05a9', 'c1feceb1-6edd-47e2-ac04-0ff050db1853', 'f0fcf296-176a-4eda-889b-c74ea0004135', '16d59613-2856-41c8-b0e8-c9d0fba0e0dd'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:34 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:34 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:35 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.551s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:35 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Deleted volume successfully. Jul 17 14:21:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-331e6887-5317-458f-a438-3f7adcd72ea8 tempest-VolumesActionsTest-1308728964 None] Lock "cinder-42e17acf-182f-4567-b632-c59f573c8265-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Flow 'volume_create_manager' (d9d5a694-13e0-4f04-93d9-cfd56cb4b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4b6210-2150-44c2-95c0-8b8ba4dbec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4b6210-2150-44c2-95c0-8b8ba4dbec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1639704336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ffbed-5223-441b-8926-97abda321639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb1ddd16b5a42008d518ad6624da499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:36Z,use_quota=True,user_id='0173afc368cc459980b1195fc4e4a08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9f377-6cb0-4a81-859e-28d70fbc9f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9f377-6cb0-4a81-859e-28d70fbc9f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e592aaa1-76c0-4a8d-86d6-f6a867671426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e592aaa1-76c0-4a8d-86d6-f6a867671426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065ffbed-5223-441b-8926-97abda321639', 'volume_name': 'volume-065ffbed-5223-441b-8926-97abda321639', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5cafea-4e4f-4ef5-bd67-e52831f9a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5cafea-4e4f-4ef5-bd67-e52831f9a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd7c166-9037-4786-9d05-26f8791569fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Volume 065ffbed-5223-441b-8926-97abda321639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065ffbed-5223-441b-8926-97abda321639', 'volume_size': 1} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1639704336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ffbed-5223-441b-8926-97abda321639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb1ddd16b5a42008d518ad6624da499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:36Z,use_quota=True,user_id='0173afc368cc459980b1195fc4e4a08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Creating volume 065ffbed-5223-441b-8926-97abda321639 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:36 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:36 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 1073741824 Jul 17 14:21:36 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:37 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 1073741824" returned: 0 in 0.799s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:37 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 Jul 17 14:21:37 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-164932cf-8bb7-49bc-820c-9e1684701c26 req-c4925704-dd81-4cb2-8d1c-705342ab1284 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:37 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639" returned: 0 in 0.350s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-164932cf-8bb7-49bc-820c-9e1684701c26 req-c4925704-dd81-4cb2-8d1c-705342ab1284 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.159s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-164932cf-8bb7-49bc-820c-9e1684701c26 req-c4925704-dd81-4cb2-8d1c-705342ab1284 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd7c166-9037-4786-9d05-26f8791569fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065ffbed-5223-441b-8926-97abda321639', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0695d69-6ab6-41a5-aab1-9d01978844ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Volume volume-065ffbed-5223-441b-8926-97abda321639 (065ffbed-5223-441b-8926-97abda321639): created successfully Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0695d69-6ab6-41a5-aab1-9d01978844ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Flow 'volume_create_manager' (d9d5a694-13e0-4f04-93d9-cfd56cb4b13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-164932cf-8bb7-49bc-820c-9e1684701c26 req-c4925704-dd81-4cb2-8d1c-705342ab1284 tempest-AttachVolumeTestJSON-431579605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-8e83df39-c92f-45a4-afce-03d97f93e9da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39eae85f-4e56-4616-8d2d-7f3d19be8621', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:21:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-17d92ac9-a602-49f3-875b-94d262b590d7 tempest-VolumesTransfersV357Test-1172691922 None] Created volume successfully. Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Flow 'volume_create_manager' (c1fdd2e0-bb26-4366-89d3-8513b8f36c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e491896c-d74c-47ed-beda-650383e7afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e491896c-d74c-47ed-beda-650383e7afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1028773802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c526f32-be51-4861-b58c-4e72060591e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9c31cc29bd4fadb19571557481bd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:38Z,use_quota=True,user_id='ef7014cbaa1547998c7541f64f3095dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bddde36-cf6d-46d8-9c12-088567cef6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bddde36-cf6d-46d8-9c12-088567cef6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206aa489-5d02-4e34-b647-550ddba5a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206aa489-5d02-4e34-b647-550ddba5a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c526f32-be51-4861-b58c-4e72060591e9', 'volume_name': 'volume-6c526f32-be51-4861-b58c-4e72060591e9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fb7295-ad4a-484c-9614-32695dc5adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fb7295-ad4a-484c-9614-32695dc5adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb5ce55-62d1-4b67-ad90-c2fd0c80c431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Volume 6c526f32-be51-4861-b58c-4e72060591e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c526f32-be51-4861-b58c-4e72060591e9', 'volume_size': 1} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1028773802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c526f32-be51-4861-b58c-4e72060591e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9c31cc29bd4fadb19571557481bd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:38Z,use_quota=True,user_id='ef7014cbaa1547998c7541f64f3095dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Creating volume 6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:37 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:38 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 1073741824 Jul 17 14:21:38 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-164932cf-8bb7-49bc-820c-9e1684701c26 req-c4925704-dd81-4cb2-8d1c-705342ab1284 tempest-AttachVolumeTestJSON-431579605 None] attachment_update completed successfully. Jul 17 14:21:38 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 1073741824" returned: 0 in 0.819s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:38 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:21:38 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:39 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.291s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb5ce55-62d1-4b67-ad90-c2fd0c80c431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c526f32-be51-4861-b58c-4e72060591e9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d5d35-4269-49bf-bc9b-1926d18d1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-77bf4724-8a5c-4cb8-8e0f-5bf22f0ac4e2 tempest-VolumesTransfersV357Test-224730676 None] Transfer volume completed successfully. Jul 17 14:21:39 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Volume volume-6c526f32-be51-4861-b58c-4e72060591e9 (6c526f32-be51-4861-b58c-4e72060591e9): created successfully Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d5d35-4269-49bf-bc9b-1926d18d1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Flow 'volume_create_manager' (c1fdd2e0-bb26-4366-89d3-8513b8f36c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c06b9dc6-0501-4b6c-b300-2c43e13e6e15 tempest-VolumesActionsTest-200305732 None] Created volume successfully. Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (29145cc7-0c46-46de-8e18-51ccc7068dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7042f5b1-73d0-412a-8c4d-e2fae0b17271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7042f5b1-73d0-412a-8c4d-e2fae0b17271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939381982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864c6760-4377-4cc8-8f72-0c4e9f49c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:40Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2000d9-1ade-4db2-a799-0533f25731d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2000d9-1ade-4db2-a799-0533f25731d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cf87-ad0e-416d-bea8-8f1866b2a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cf87-ad0e-416d-bea8-8f1866b2a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864c6760-4377-4cc8-8f72-0c4e9f49c190', 'volume_name': 'volume-864c6760-4377-4cc8-8f72-0c4e9f49c190', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd6622-3e7d-4eae-9eb7-3fee2626a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd6622-3e7d-4eae-9eb7-3fee2626a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a6ea81-3ac4-4c73-95ff-cded4568aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:40 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Volume 864c6760-4377-4cc8-8f72-0c4e9f49c190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864c6760-4377-4cc8-8f72-0c4e9f49c190', 'volume_size': 1} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939381982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864c6760-4377-4cc8-8f72-0c4e9f49c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:40Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Creating volume 864c6760-4377-4cc8-8f72-0c4e9f49c190 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:40 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "cinder-065ffbed-5223-441b-8926-97abda321639-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:40 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 1073741824 Jul 17 14:21:40 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-065ffbed-5223-441b-8926-97abda321639-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "cinder-quobyte-065ffbed-5223-441b-8926-97abda321639" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-quobyte-065ffbed-5223-441b-8926-97abda321639" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5df8e0-270a-44c6-8419-52187e0ef0ad]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:40 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 Jul 17 14:21:40 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:40 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-2568b8d3-c696-47ad-bbdd-7c96273ef789 req-1474b648-bab3-47aa-a092-25858e3e3e6a tempest-AttachVolumeTestJSON-431579605 None] Terminate volume connection completed successfully. Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-2568b8d3-c696-47ad-bbdd-7c96273ef789 req-1474b648-bab3-47aa-a092-25858e3e3e6a tempest-AttachVolumeTestJSON-431579605 None] Deleting attachment 8b9d4a7c-cfba-4247-aa96-4ae48d5d4aa3. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:21:40 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 1073741824" returned: 0 in 0.610s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:40 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 Jul 17 14:21:40 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:40 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639" returned: 0 in 0.554s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:40 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639 Jul 17 14:21:40 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:40 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190" returned: 0 in 0.300s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a6ea81-3ac4-4c73-95ff-cded4568aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864c6760-4377-4cc8-8f72-0c4e9f49c190', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aca291e-06e1-4e7b-a952-131d962c99cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:41 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Volume volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 (864c6760-4377-4cc8-8f72-0c4e9f49c190): created successfully Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aca291e-06e1-4e7b-a952-131d962c99cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (29145cc7-0c46-46de-8e18-51ccc7068dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:41 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-065ffbed-5223-441b-8926-97abda321639" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a5d4bea6-680c-42f5-969c-74782fbfe4f0 tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-quobyte-065ffbed-5223-441b-8926-97abda321639" released by "delete_volume" :: held 0.975s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Created reservations ['aed69658-8599-41b9-a524-acd169e9301c', '7f218038-d5a4-4adf-a4e8-c4d59ababa62', 'c9d73227-f30e-47db-a1c8-74b6972d0cae', '301e0db2-ca0f-485b-9f31-b8321fdd5d7a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:41 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:41 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:41 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.302s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Deleted volume successfully. Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a6c8c24-3b40-455c-b0c0-276599ef12de tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-065ffbed-5223-441b-8926-97abda321639-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-c150eb9e-8442-49e3-985d-9d2bf461a6d1 req-c9bc0b36-f1f7-455f-9486-74b04dfef787 tempest-AttachVolumeTestJSON-431579605 None] Terminate volume connection completed successfully. Jul 17 14:21:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-c150eb9e-8442-49e3-985d-9d2bf461a6d1 req-c9bc0b36-f1f7-455f-9486-74b04dfef787 tempest-AttachVolumeTestJSON-431579605 None] Deleting attachment 39eae85f-4e56-4616-8d2d-7f3d19be8621. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-864c6760-4377-4cc8-8f72-0c4e9f49c190-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-864c6760-4377-4cc8-8f72-0c4e9f49c190-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-quobyte-864c6760-4377-4cc8-8f72-0c4e9f49c190" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-864c6760-4377-4cc8-8f72-0c4e9f49c190" acquired by "delete_volume" :: waited 0.044s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c476f24-5bd0-4087-927c-64f045f865db]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:42 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 Jul 17 14:21:42 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:43 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190" returned: 0 in 0.658s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:43 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190 Jul 17 14:21:43 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Flow 'volume_create_manager' (0ff9cc41-6ef1-41c0-9f7b-b481fda35454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2c6c0a-e456-4c93-8285-ad35955329ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2c6c0a-e456-4c93-8285-ad35955329ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-662832051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cdff0c-c463-4147-b0e8-878ff362ce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb1ddd16b5a42008d518ad6624da499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:43Z,use_quota=True,user_id='0173afc368cc459980b1195fc4e4a08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7be6d-6c98-4434-bb9f-015367a14477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7be6d-6c98-4434-bb9f-015367a14477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b0d9e1-c7df-49be-b5c5-b95e8b53db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b0d9e1-c7df-49be-b5c5-b95e8b53db64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4cdff0c-c463-4147-b0e8-878ff362ce48', 'volume_name': 'volume-a4cdff0c-c463-4147-b0e8-878ff362ce48', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf9f9f6-0ecc-4729-9f4a-3688c65f1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf9f9f6-0ecc-4729-9f4a-3688c65f1473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50decab-7196-4ffd-80e0-f7313e0e5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Volume a4cdff0c-c463-4147-b0e8-878ff362ce48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4cdff0c-c463-4147-b0e8-878ff362ce48', 'volume_size': 1} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-662832051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cdff0c-c463-4147-b0e8-878ff362ce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb1ddd16b5a42008d518ad6624da499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:43Z,use_quota=True,user_id='0173afc368cc459980b1195fc4e4a08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Creating volume a4cdff0c-c463-4147-b0e8-878ff362ce48 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:43 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:43 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 1073741824 Jul 17 14:21:43 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:43 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-864c6760-4377-4cc8-8f72-0c4e9f49c190" returned: 0 in 0.477s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-864c6760-4377-4cc8-8f72-0c4e9f49c190" released by "delete_volume" :: held 1.203s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Created reservations ['da92f5a1-bb74-4f3d-a05b-09e4510dc930', '19a9b1a0-22fd-425e-9170-e7468543d8f7', '9e9fe53a-14a4-47af-b3e7-31cb5082c860', '31d82d15-a8e4-4a22-a0fe-63af51a246b2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:43 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:43 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:44 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 1073741824" returned: 0 in 1.031s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:44 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.648s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Deleted volume successfully. Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:44 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-df888c70-f570-41a5-81ff-3604024587f4 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-864c6760-4377-4cc8-8f72-0c4e9f49c190-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:44 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:44 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48" returned: 0 in 0.375s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50decab-7196-4ffd-80e0-f7313e0e5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cdff0c-c463-4147-b0e8-878ff362ce48', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df19d5-1a62-4c0f-9b07-a49f02ddb217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Volume volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 (a4cdff0c-c463-4147-b0e8-878ff362ce48): created successfully Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df19d5-1a62-4c0f-9b07-a49f02ddb217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Flow 'volume_create_manager' (0ff9cc41-6ef1-41c0-9f7b-b481fda35454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fff437a2-acf5-448c-acd3-76e25a7aabe3 tempest-VolumesTransfersV357Test-1172691922 None] Created volume successfully. Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (9835e5b0-677b-435a-8833-225ecf78b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4fa833-96af-4013-8d89-721d480cf4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4fa833-96af-4013-8d89-721d480cf4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1790337147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:45Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9538a40c-cb4a-4399-a41a-bd32e4cce5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9538a40c-cb4a-4399-a41a-bd32e4cce5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ca7ee9-db04-435f-8c33-ef0c430b1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ca7ee9-db04-435f-8c33-ef0c430b1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a', 'volume_name': 'volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343ef4b3-778b-48ce-bb87-8c24e62430f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343ef4b3-778b-48ce-bb87-8c24e62430f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b994744e-96a3-4d10-84f8-ed57faa09394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Volume 30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a', 'volume_size': 1} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1790337147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:45Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Creating volume 30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:45 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:45 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a 1073741824 Jul 17 14:21:45 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "cinder-a4cdff0c-c463-4147-b0e8-878ff362ce48-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-a4cdff0c-c463-4147-b0e8-878ff362ce48-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "cinder-quobyte-a4cdff0c-c463-4147-b0e8-878ff362ce48" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-quobyte-a4cdff0c-c463-4147-b0e8-878ff362ce48" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b66e07-bc05-402f-bfdd-59461058c279]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:46 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 Jul 17 14:21:46 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:46 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a 1073741824" returned: 0 in 0.904s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:46 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a Jul 17 14:21:46 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:46 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48" returned: 0 in 0.663s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:46 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48 Jul 17 14:21:46 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:46 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b994744e-96a3-4d10-84f8-ed57faa09394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff14ffd-2d5a-4836-a819-717bc4eb043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:47 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Volume volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a (30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a): created successfully Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff14ffd-2d5a-4836-a819-717bc4eb043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (9835e5b0-677b-435a-8833-225ecf78b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e70a400d-66db-4cb5-ab48-345315fc6c5d tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:21:47 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a4cdff0c-c463-4147-b0e8-878ff362ce48" returned: 0 in 0.330s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-quobyte-a4cdff0c-c463-4147-b0e8-878ff362ce48" released by "delete_volume" :: held 1.079s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Created reservations ['b1543a9e-1bee-4f8c-a181-35d4b0dd91ed', '168bfb7e-8aea-473e-bf80-205ba4be0bf8', 'a464d563-efd0-4f5f-9b36-609fcc322ca8', '9d6c452c-17cc-41b9-91e5-417be116714e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:47 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:47 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:47 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.514s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:47 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Deleted volume successfully. Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7aae99d7-3aa6-4adb-9a72-78935953f8ce tempest-VolumesTransfersV357Test-489060486 None] Lock "cinder-a4cdff0c-c463-4147-b0e8-878ff362ce48-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "cinder-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-quobyte-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" acquired by "delete_volume" :: waited 0.052s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[660faf59-1499-4fa4-910a-9588cacfc451]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:48 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a Jul 17 14:21:48 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:49 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" returned: 0 in 1.057s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:49 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a Jul 17 14:21:49 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:50 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" returned: 0 in 0.512s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a" released by "delete_volume" :: held 1.703s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Created reservations ['a17e3e16-8dcb-4cb7-babe-cf2e3b4dedcc', 'c9484f7e-87f1-4b4e-b547-cc7b8a13755b', '9f977cee-503d-4f32-91d5-9f72e95ea333', 'a478e558-1003-4309-a7e1-34f566d0a678'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-8e83df39-c92f-45a4-afce-03d97f93e9da-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:50 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:50 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-8e83df39-c92f-45a4-afce-03d97f93e9da-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-quobyte-8e83df39-c92f-45a4-afce-03d97f93e9da" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-8e83df39-c92f-45a4-afce-03d97f93e9da" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eccc2c5-fa7d-406b-ab2a-c3440dcedace]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:50 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Deleted volume successfully. Jul 17 14:21:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-79e6ac02-ded1-441e-b81d-8ab7983db5de tempest-VolumesActionsTest-1350189224 None] Lock "cinder-30b6ee5b-30a0-4f2f-9a2e-4dd88a6d352a-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:50 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da Jul 17 14:21:50 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:51 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da" returned: 0 in 0.823s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:51 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da Jul 17 14:21:51 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:52 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (d761a5cc-c036-43ed-b830-7b0d0762872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117335b-555c-4571-ba03-8a1d7ca8fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8e83df39-c92f-45a4-afce-03d97f93e9da" returned: 0 in 0.628s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-8e83df39-c92f-45a4-afce-03d97f93e9da" released by "delete_volume" :: held 1.634s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117335b-555c-4571-ba03-8a1d7ca8fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185732476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9376cd2e-c73d-4290-a766-78151a376d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:52Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a228fd8-cfe0-40dc-95d2-ff69e29c6278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a228fd8-cfe0-40dc-95d2-ff69e29c6278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a220e24e-1802-4b08-9589-d5f08fcf618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a220e24e-1802-4b08-9589-d5f08fcf618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9376cd2e-c73d-4290-a766-78151a376d27', 'volume_name': 'volume-9376cd2e-c73d-4290-a766-78151a376d27', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa403eda-e5c8-474e-8b41-3e4442f8bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa403eda-e5c8-474e-8b41-3e4442f8bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45ac5aa-d1db-4c8b-bb23-5702692fd561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:52 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Volume 9376cd2e-c73d-4290-a766-78151a376d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9376cd2e-c73d-4290-a766-78151a376d27', 'volume_size': 1} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185732476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9376cd2e-c73d-4290-a766-78151a376d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:52Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Creating volume 9376cd2e-c73d-4290-a766-78151a376d27 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:52 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9bc3ef86-6b09-4967-9edc-6acd60e209b5 tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" by "attach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:52 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 1073741824 Jul 17 14:21:52 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9bc3ef86-6b09-4967-9edc-6acd60e209b5 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" acquired by "attach_volume" :: waited 0.128s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=134,cinder:DELETE=13,cinder:SELECT=103,cinder:INSERT=34 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Created reservations ['7d5c660a-ae13-45e6-a703-67909bbd6120', 'a28ed882-3421-419f-9d5b-ad70d3af2446', '5eb4ff36-2ce1-433f-a00e-3c6844ffddc4', '621d855e-1b1c-4d17-8488-67360d7dfcff'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9bc3ef86-6b09-4967-9edc-6acd60e209b5 tempest-VolumesActionsTest-200305732 None] Attaching volume 6c526f32-be51-4861-b58c-4e72060591e9 to instance bffc9a66-6e8a-41f8-80ed-92f5dbac53df at mountpoint /dev/vdb on host None. Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=115,cinder:INSERT=29,cinder:UPDATE=129,cinder:DELETE=9 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:21:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9bc3ef86-6b09-4967-9edc-6acd60e209b5 tempest-VolumesActionsTest-200305732 None] Attach volume completed successfully. Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9bc3ef86-6b09-4967-9edc-6acd60e209b5 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" released by "attach_volume" :: held 0.274s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:52 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:52 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-2a673a6f-e267-4c24-b114-bfb5eaa4cefa-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9fae4f58-bef3-440a-aeee-37b0d0bccf7f tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" by "detach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9fae4f58-bef3-440a-aeee-37b0d0bccf7f tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" acquired by "detach_volume" :: waited 0.092s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9fae4f58-bef3-440a-aeee-37b0d0bccf7f tempest-VolumesActionsTest-200305732 None] Detaching volume 6c526f32-be51-4861-b58c-4e72060591e9 from instance bffc9a66-6e8a-41f8-80ed-92f5dbac53df. Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-2a673a6f-e267-4c24-b114-bfb5eaa4cefa-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:53 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 1073741824" returned: 0 in 0.964s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-quobyte-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" acquired by "delete_volume" :: waited 0.044s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:53 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9fae4f58-bef3-440a-aeee-37b0d0bccf7f tempest-VolumesActionsTest-200305732 None] Detach volume completed successfully. Jul 17 14:21:53 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 Jul 17 14:21:53 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.627s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Deleted volume successfully. Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0a3891-dfc8-4428-984a-6df56b5449a0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-9fae4f58-bef3-440a-aeee-37b0d0bccf7f tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" released by "detach_volume" :: held 0.283s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-240eaf79-fd0f-45a7-af98-83f97a938e87 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-8e83df39-c92f-45a4-afce-03d97f93e9da-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:53 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa Jul 17 14:21:53 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:53 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27" returned: 0 in 0.417s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45ac5aa-d1db-4c8b-bb23-5702692fd561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9376cd2e-c73d-4290-a766-78151a376d27', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc6951-d55c-493b-ad52-8035cef8bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:53 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Volume volume-9376cd2e-c73d-4290-a766-78151a376d27 (9376cd2e-c73d-4290-a766-78151a376d27): created successfully Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc6951-d55c-493b-ad52-8035cef8bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (d761a5cc-c036-43ed-b830-7b0d0762872c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-21168fa7-91a0-4820-a50d-98bea5306fed tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:21:54 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" returned: 0 in 0.725s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:54 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa Jul 17 14:21:54 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:54 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" returned: 0 in 0.559s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-2a673a6f-e267-4c24-b114-bfb5eaa4cefa" released by "delete_volume" :: held 1.368s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Created reservations ['f0669790-50e4-4e97-9bc2-1e5680cdcc54', '1ac8530e-8aa5-4e06-a606-e5f3253eabdb', 'c857a79b-826b-4c93-bd45-e1eb72c747b0', 'c9a4cddc-7ff1-4cd1-a24e-6872610212d7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:55 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:55 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-9376cd2e-c73d-4290-a766-78151a376d27-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "cinder-9376cd2e-c73d-4290-a766-78151a376d27-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-quobyte-9376cd2e-c73d-4290-a766-78151a376d27" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:55 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.615s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-9376cd2e-c73d-4290-a766-78151a376d27" acquired by "delete_volume" :: waited 0.048s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Deleted volume successfully. Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30eb8b5-7848-4e83-8798-a45718bed368]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1f3832f2-d132-402b-974c-5a92cf7b5242 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-2a673a6f-e267-4c24-b114-bfb5eaa4cefa-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-83cfcede-ddc2-48fb-b0a6-ba74a416b920-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-83cfcede-ddc2-48fb-b0a6-ba74a416b920-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "cinder-quobyte-83cfcede-ddc2-48fb-b0a6-ba74a416b920" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:21:55 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 Jul 17 14:21:55 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-83cfcede-ddc2-48fb-b0a6-ba74a416b920" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d6dfa4-b00f-4dcd-bbf6-0c8045b70ac4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:21:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:56 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 Jul 17 14:21:56 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:56 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27" returned: 0 in 0.664s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:56 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27 Jul 17 14:21:56 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:56 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920" returned: 0 in 0.617s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:56 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920 Jul 17 14:21:56 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:56 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9376cd2e-c73d-4290-a766-78151a376d27" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-9376cd2e-c73d-4290-a766-78151a376d27" released by "delete_volume" :: held 1.131s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Created reservations ['d05e9889-a42b-42f0-8bca-6fe356a7e702', '2075ec22-f5f5-4fd9-801e-c04bd731f6da', '4b276520-e9a8-4d0f-8d3c-02116759c76c', '3eb39b31-6693-45b7-b335-ed7c959b4a9a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:57 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83cfcede-ddc2-48fb-b0a6-ba74a416b920" returned: 0 in 0.438s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:57 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:57 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-quobyte-83cfcede-ddc2-48fb-b0a6-ba74a416b920" released by "delete_volume" :: held 1.130s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Created reservations ['7da3134f-4283-4824-ab14-2ebec0e5db78', '7d8c1f78-7bea-40e3-8e64-90281edf0738', '51468e32-c1c6-425a-beda-ff4015df229b', 'a94e4eb8-fce4-48af-98c6-d32fb1baa865'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:57 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:21:57 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:57 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Deleted volume successfully. Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dd4af7bf-4a58-4f79-9e58-e2b95cbe8e4f tempest-VolumesActionsTest-1350189224 None] Lock "cinder-9376cd2e-c73d-4290-a766-78151a376d27-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:57 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.332s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:21:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Deleted volume successfully. Jul 17 14:21:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78e34212-5573-4a01-9ab5-c7752e8a8461 tempest-AttachVolumeTestJSON-431579605 None] Lock "cinder-83cfcede-ddc2-48fb-b0a6-ba74a416b920-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (ef371bb2-163d-45f3-84de-296fda7c3780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be9b44-8a46-4a32-9473-7f33afa5beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be9b44-8a46-4a32-9473-7f33afa5beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425833068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2a0e8a-5cef-497d-a0c4-060d5157cccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:59Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0161803-415c-4cf4-a3be-dbfedd76dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0161803-415c-4cf4-a3be-dbfedd76dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f6001-de38-4c7f-a306-84032ee64b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f6001-de38-4c7f-a306-84032ee64b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2a0e8a-5cef-497d-a0c4-060d5157cccf', 'volume_name': 'volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab12ebd-5ec5-437c-b53e-5503127d3856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab12ebd-5ec5-437c-b53e-5503127d3856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a8f433-d4e1-442a-a276-936376d01aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:21:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Volume 0b2a0e8a-5cef-497d-a0c4-060d5157cccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf', 'volume_size': 1} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425833068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2a0e8a-5cef-497d-a0c4-060d5157cccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:21:59Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Creating volume 0b2a0e8a-5cef-497d-a0c4-060d5157cccf {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:21:58 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:21:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:58 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf 1073741824 Jul 17 14:21:58 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:59 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf 1073741824" returned: 0 in 0.685s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:21:59 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf Jul 17 14:21:59 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:21:59 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 17 14:21:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" returned: 0 in 0.438s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:21:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:21:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a8f433-d4e1-442a-a276-936376d01aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a858af-4e4c-4443-9965-b17b20c4a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:00 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Volume volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf (0b2a0e8a-5cef-497d-a0c4-060d5157cccf): created successfully Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a858af-4e4c-4443-9965-b17b20c4a308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (ef371bb2-163d-45f3-84de-296fda7c3780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a57b3224-33ee-46ee-98a6-b3338962b102 tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Flow 'volume_create_manager' (cf2a5516-2cf6-413c-b50d-0961a766bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec17243-aff0-4644-b3bb-6fbcbe33ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec17243-aff0-4644-b3bb-6fbcbe33ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-183423767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47007405-0fc1-432c-a792-a9868f7d2d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12afacb327ba42b6a8c055850f8327b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:01Z,use_quota=True,user_id='a1ec8afd28984e0da3baeb4aa7cfb511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4aae58e-2d8d-4d3a-91d8-04e2cdd2e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4aae58e-2d8d-4d3a-91d8-04e2cdd2e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf88f47-9b8b-44ea-8a0b-81a981106a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:00 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-0b2a0e8a-5cef-497d-a0c4-060d5157cccf-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-0b2a0e8a-5cef-497d-a0c4-060d5157cccf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "cinder-quobyte-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" acquired by "delete_volume" :: waited 0.053s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca3f137-ee2c-4f44-b3b3-78b929270010]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf88f47-9b8b-44ea-8a0b-81a981106a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47007405-0fc1-432c-a792-a9868f7d2d52', 'volume_name': 'volume-47007405-0fc1-432c-a792-a9868f7d2d52', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b08ab3-73b6-4439-a55e-995f7fd99d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b08ab3-73b6-4439-a55e-995f7fd99d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bc14db-5919-445b-95a5-ee8eba0b1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Volume 47007405-0fc1-432c-a792-a9868f7d2d52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47007405-0fc1-432c-a792-a9868f7d2d52', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 14:22:01 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Trying to clone 47007405-0fc1-432c-a792-a9868f7d2d52 from image fe33b284-d390-4ad6-9a67-4047a22fe63a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:22:01 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf Jul 17 14:22:01 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:22:02 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Image download 20.69 MB at 20.69 MB/s Jul 17 14:22:02 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" returned: 0 in 0.758s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c296ca-da12-4a8a-81b7-6ed6790fe9ee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:02 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf Jul 17 14:22:02 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:02 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD Jul 17 14:22:02 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:02 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" returned: 0 in 0.471s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-quobyte-0b2a0e8a-5cef-497d-a0c4-060d5157cccf" released by "delete_volume" :: held 1.319s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Created reservations ['533154fc-b7ae-476d-9d6b-a118cc20901e', 'ab1af468-2419-421a-81d1-1ab4efd3fcbd', 'f01b25a0-9256-49c0-a238-1e0770d89d07', '8276038e-4e39-4edc-aea7-7617c5c791aa'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:22:02 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a is fetched for user a1ec8afd28984e0da3baeb4aa7cfb511. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:02 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:22:02 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd2b30-cd75-4efd-8866-69f8c813bc16]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:03 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD Jul 17 14:22:03 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:03 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.450s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:22:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Deleted volume successfully. Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e92f9a94-515d-4d11-8e82-f797e7e51679 tempest-VolumesActionsTest-1350189224 None] Lock "cinder-0b2a0e8a-5cef-497d-a0c4-060d5157cccf-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:03 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD" returned: 0 in 0.644s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-183423767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47007405-0fc1-432c-a792-a9868f7d2d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12afacb327ba42b6a8c055850f8327b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:01Z,use_quota=True,user_id='a1ec8afd28984e0da3baeb4aa7cfb511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Creating volume 47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:22:03 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:22:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:03 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1073741824 Jul 17 14:22:03 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:04 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1073741824" returned: 0 in 0.712s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:04 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 Jul 17 14:22:04 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (9d08df60-fe7d-451e-bab3-c6ab78c3fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29070421-8f4c-433b-a6bc-c0c8eac47dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29070421-8f4c-433b-a6bc-c0c8eac47dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-904010640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b073d7-57dc-488a-88ac-cf95e3399836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:04Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825604a5-8a50-4f39-b402-75947e832f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825604a5-8a50-4f39-b402-75947e832f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec0b9a0-f410-46f2-8c49-f35cfb1cb75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec0b9a0-f410-46f2-8c49-f35cfb1cb75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b073d7-57dc-488a-88ac-cf95e3399836', 'volume_name': 'volume-b7b073d7-57dc-488a-88ac-cf95e3399836', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ef453-1425-485d-b44b-b4935967b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ef453-1425-485d-b44b-b4935967b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb9e1c3-db34-4984-a8ab-71eb39fa9f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Volume b7b073d7-57dc-488a-88ac-cf95e3399836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b073d7-57dc-488a-88ac-cf95e3399836', 'volume_size': 1} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:04 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-904010640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b073d7-57dc-488a-88ac-cf95e3399836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5362744f04b349d3be9e73ad6c5c05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:04Z,use_quota=True,user_id='a2aadca85adc443cac39b855c5c551aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Creating volume b7b073d7-57dc-488a-88ac-cf95e3399836 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:22:04 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:04 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 1073741824 Jul 17 14:22:04 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Attempting download of fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume 47007405-0fc1-432c-a792-a9868f7d2d52. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb1dbb-170d-42a5-ace8-74ed92a3e59d]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:05 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh Jul 17 14:22:05 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:05 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:05 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh" returned: 0 in 0.536s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 1073741824" returned: 0 in 0.770s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:05 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 Jul 17 14:22:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:05 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:05 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh Jul 17 14:22:05 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:06 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836" returned: 0 in 0.725s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb9e1c3-db34-4984-a8ab-71eb39fa9f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b073d7-57dc-488a-88ac-cf95e3399836', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d1363d-7ce2-4043-b1e3-68a6cc2a53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:06 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Volume volume-b7b073d7-57dc-488a-88ac-cf95e3399836 (b7b073d7-57dc-488a-88ac-cf95e3399836): created successfully Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d1363d-7ce2-4043-b1e3-68a6cc2a53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Flow 'volume_create_manager' (9d08df60-fe7d-451e-bab3-c6ab78c3fec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ac3cf61f-b0d3-41cf-9247-f6c5377605aa tempest-VolumesActionsTest-1308728964 None] Created volume successfully. Jul 17 14:22:06 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh" returned: 1 in 1.041s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_syaivjfh' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df715ab-b696-4df8-ba4c-69e7b1040dc6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:06 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD Jul 17 14:22:06 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:07 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD" returned: 0 in 0.659s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:07 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] fe33b284-d390-4ad6-9a67-4047a22fe63a was qcow2, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:22:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:07 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 Jul 17 14:22:07 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-b7b073d7-57dc-488a-88ac-cf95e3399836-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "cinder-b7b073d7-57dc-488a-88ac-cf95e3399836-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Acquiring lock "cinder-quobyte-b7b073d7-57dc-488a-88ac-cf95e3399836" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "cinder-quobyte-b7b073d7-57dc-488a-88ac-cf95e3399836" acquired by "delete_volume" :: waited 0.042s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:09 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[32485b2e-7a98-4498-98b9-7d402b651e72]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:09 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 Jul 17 14:22:09 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:09 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836" returned: 0 in 0.739s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:09 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836 Jul 17 14:22:09 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-65d6297d-1150-4736-ab3b-833a0d74c2e3 tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" by "attach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-65d6297d-1150-4736-ab3b-833a0d74c2e3 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" acquired by "attach_volume" :: waited 0.038s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-65d6297d-1150-4736-ab3b-833a0d74c2e3 tempest-VolumesActionsTest-200305732 None] Attaching volume 6c526f32-be51-4861-b58c-4e72060591e9 to instance 84c0ad14-321a-4052-84b7-857939987586 at mountpoint /dev/vdb on host None. Jul 17 14:22:10 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b7b073d7-57dc-488a-88ac-cf95e3399836" returned: 0 in 0.508s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-65d6297d-1150-4736-ab3b-833a0d74c2e3 tempest-VolumesActionsTest-200305732 None] Attach volume completed successfully. Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "cinder-quobyte-b7b073d7-57dc-488a-88ac-cf95e3399836" released by "delete_volume" :: held 1.330s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-65d6297d-1150-4736-ab3b-833a0d74c2e3 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9" released by "attach_volume" :: held 0.234s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Created reservations ['941e101c-3da1-41d5-b191-5096775af7a2', '8631c2bf-aac1-4f7d-a54a-e63be54bd189', '78ffb505-28da-4ea5-b129-18bc3e6c49ba', 'ab0d8caa-692c-42fa-bc9b-103131ab889a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:10 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:10 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52" returned: 0 in 3.430s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_oevz3ew_devstack@QuobyteHD, size 112.00 MB, duration 3.43 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:22:10 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Converted 112.00 MB image at 32.61 MB/s Jul 17 14:22:10 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7ddd16f8-f886-476b-923b-1b14914aaf78 tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" by "detach_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:10 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1G Jul 17 14:22:10 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7ddd16f8-f886-476b-923b-1b14914aaf78 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7ddd16f8-f886-476b-923b-1b14914aaf78 tempest-VolumesActionsTest-200305732 None] Detaching volume 6c526f32-be51-4861-b58c-4e72060591e9 from instance 84c0ad14-321a-4052-84b7-857939987586. Jul 17 14:22:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7ddd16f8-f886-476b-923b-1b14914aaf78 tempest-VolumesActionsTest-200305732 None] Detach volume completed successfully. Jul 17 14:22:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7ddd16f8-f886-476b-923b-1b14914aaf78 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:11 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.583s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:22:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Deleted volume successfully. Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8a71fd1d-43ec-4879-890b-82f0374cd77e tempest-VolumesActionsTest-1308728964 None] Lock "cinder-b7b073d7-57dc-488a-88ac-cf95e3399836-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:11 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 1G" returned: 0 in 0.708s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Downloaded image fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume 47007405-0fc1-432c-a792-a9868f7d2d52 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a for user a1ec8afd28984e0da3baeb4aa7cfb511 is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Marking volume 47007405-0fc1-432c-a792-a9868f7d2d52 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Copying metadata from image fe33b284-d390-4ad6-9a67-4047a22fe63a to 47007405-0fc1-432c-a792-a9868f7d2d52. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Creating volume glance metadata for volume 47007405-0fc1-432c-a792-a9868f7d2d52 backed by image fe33b284-d390-4ad6-9a67-4047a22fe63a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bc14db-5919-445b-95a5-ee8eba0b1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47007405-0fc1-432c-a792-a9868f7d2d52', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e24f781-ac09-4333-b42d-c8ce52c30a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Volume volume-47007405-0fc1-432c-a792-a9868f7d2d52 (47007405-0fc1-432c-a792-a9868f7d2d52): created successfully Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e24f781-ac09-4333-b42d-c8ce52c30a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Flow 'volume_create_manager' (cf2a5516-2cf6-413c-b50d-0961a766bd92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-20cf52e1-e859-44c6-8d97-aa3b91fb7a81 tempest-VolumesExtendTest-372529331 None] Created volume successfully. Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7a91f-7f1b-4606-be9c-b57aee70357f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:12 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 Jul 17 14:22:12 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:12 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52" returned: 0 in 0.486s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 2G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 2G" returned: 0 in 0.158s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-875ad0a7-7573-4cbd-bc73-ec3c7688ad2a tempest-VolumesExtendTest-372529331 None] Extend volume completed successfully. Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-47007405-0fc1-432c-a792-a9868f7d2d52-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "cinder-47007405-0fc1-432c-a792-a9868f7d2d52-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-quobyte-47007405-0fc1-432c-a792-a9868f7d2d52" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-47007405-0fc1-432c-a792-a9868f7d2d52" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ef9a61-2c7f-4597-966d-edda4e5f6f8c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:14 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 Jul 17 14:22:14 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:14 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52" returned: 0 in 0.498s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:14 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52 Jul 17 14:22:14 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:14 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-47007405-0fc1-432c-a792-a9868f7d2d52" returned: 0 in 0.331s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-47007405-0fc1-432c-a792-a9868f7d2d52" released by "delete_volume" :: held 0.888s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Created reservations ['83d67ff8-0ac2-4143-8d8a-11f941669192', 'fdfa7019-c532-4eaa-a544-f0cba25d9f06', '7da6bde2-1649-4d81-8b77-02f25804e77f', '046c2385-6f19-4c02-977e-fdc3c586ff15'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:15 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:22:15 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:15 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.339s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:22:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Deleted volume successfully. Jul 17 14:22:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-87ae281d-762d-4326-9328-275b93268dc3 tempest-VolumesExtendTest-372529331 None] Lock "cinder-47007405-0fc1-432c-a792-a9868f7d2d52-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Flow 'volume_create_manager' (6b76ce70-5290-4f53-b173-b2f9a7ee8604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648c9683-9e75-450d-bd60-ff32c81a976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648c9683-9e75-450d-bd60-ff32c81a976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2104249761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8e06cb-5791-4b25-a73e-135904c66479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12afacb327ba42b6a8c055850f8327b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:17Z,use_quota=True,user_id='a1ec8afd28984e0da3baeb4aa7cfb511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8127c-2564-4c3d-b981-b0956529ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8127c-2564-4c3d-b981-b0956529ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94b216a-d014-4953-a3a2-9cf2a0fa620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94b216a-d014-4953-a3a2-9cf2a0fa620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8e06cb-5791-4b25-a73e-135904c66479', 'volume_name': 'volume-0c8e06cb-5791-4b25-a73e-135904c66479', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71f1556-c3dd-4f63-9f40-4f56bc5fe30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71f1556-c3dd-4f63-9f40-4f56bc5fe30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2567b2b-6e61-48fa-9b85-e89fd19d325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Volume 0c8e06cb-5791-4b25-a73e-135904c66479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8e06cb-5791-4b25-a73e-135904c66479', 'volume_size': 1} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2104249761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8e06cb-5791-4b25-a73e-135904c66479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12afacb327ba42b6a8c055850f8327b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:17Z,use_quota=True,user_id='a1ec8afd28984e0da3baeb4aa7cfb511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Creating volume 0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:22:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:22:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:16 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 1073741824 Jul 17 14:22:16 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:17 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 1073741824" returned: 0 in 0.651s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:17 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:22:17 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:17 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.340s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:22:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2567b2b-6e61-48fa-9b85-e89fd19d325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8e06cb-5791-4b25-a73e-135904c66479', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56132bbd-f658-45a3-b204-df349c08f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Volume volume-0c8e06cb-5791-4b25-a73e-135904c66479 (0c8e06cb-5791-4b25-a73e-135904c66479): created successfully Jul 17 14:22:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56132bbd-f658-45a3-b204-df349c08f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Flow 'volume_create_manager' (6b76ce70-5290-4f53-b173-b2f9a7ee8604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6b8fe8ca-01cb-4da5-89a5-adc8ab487557 tempest-VolumesExtendTest-372529331 None] Created volume successfully. Jul 17 14:22:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Creating offline snapshot f1874abb-f067-4ff3-820e-d6b7fdbfca0a of volume 0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:22:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b6710-49ff-49c1-bc47-5ad62526b802]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:19 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:22:19 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:20 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.603s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:20 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a 1G Jul 17 14:22:20 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:20 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a 1G" returned: 0 in 0.681s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8e06cb-5791-4b25-a73e-135904c66479 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:20 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8e06cb-5791-4b25-a73e-135904c66479 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a Jul 17 14:22:20 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:21 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8e06cb-5791-4b25-a73e-135904c66479 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a" returned: 0 in 0.388s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:21 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a is being set with open permissions: ugo+rw Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:21 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a Jul 17 14:22:21 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:21 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a" returned: 0 in 0.416s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:21 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info Jul 17 14:22:21 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:21 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:21 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info is being set with open permissions: ugo+rw Jul 17 14:22:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:21 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info Jul 17 14:22:21 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:22 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.info" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.651s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b290517-b982-4bb3-b0de-d4fad24f07ca]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5836595e-3e14-4097-a325-ffa945382d9f tempest-VolumesExtendTest-372529331 None] Create snapshot completed successfully Jul 17 14:22:22 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:22:22 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:22 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.552s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7b67c-c736-4e2b-a6c4-2b9a744e7a28]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:23 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:22:23 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:23 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.575s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69aofnuo_o7.img {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:23 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69aofnuo_o7.img Jul 17 14:22:23 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:25 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:22:25 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:26 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.699s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:22:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:22:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:22:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:22:30 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69aofnuo_o7.img" returned: 0 in 6.636s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2787fac6-f007-401f-a5a9-2d5db8b865bb]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:30 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:22:30 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:30 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.546s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69aofnuo_o7.img {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:22:30 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Converted 1024.00 MB image at 154.28 MB/s Jul 17 14:22:30 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] 9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69a was raw, no need to convert to raw {{(pid=87804) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Flow 'volume_create_manager' (9615440f-7a44-4e70-b19d-436ef3e1ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc8222c-bf91-4aa6-b153-ac0f2cc4aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc8222c-bf91-4aa6-b153-ac0f2cc4aad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-743149881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86efd307-389a-4dc9-9cdf-b1e1a318148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed25401f8c514f3fb2880a79a8bc43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:40Z,use_quota=True,user_id='1aceff6296d74fac88b8b896a50d2231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03817508-0e03-407f-94ab-5ee696160f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03817508-0e03-407f-94ab-5ee696160f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c9967-7867-4c39-b838-8ff07610043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c9967-7867-4c39-b838-8ff07610043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86efd307-389a-4dc9-9cdf-b1e1a318148a', 'volume_name': 'volume-86efd307-389a-4dc9-9cdf-b1e1a318148a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bec50aa-fef1-4fab-b453-01f1bf313a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bec50aa-fef1-4fab-b453-01f1bf313a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070ee338-510f-4063-b293-7dc6e818b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:40 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Volume 86efd307-389a-4dc9-9cdf-b1e1a318148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86efd307-389a-4dc9-9cdf-b1e1a318148a', 'volume_size': 1} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:40 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=63,cinder:UPDATE=80,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:22:50 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=76,cinder:SELECT=68,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.067s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Uploaded volume to glance image-id: 9cfce5cb-bcd4-4a9c-ad38-5e2c1fc0e69a. {{(pid=87804) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 33.606s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93dcc0b-cf29-4c19-9dcd-8f98dc23d29b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-17cf818a-c392-4eb4-97a4-4118b045fbc2 tempest-VolumesActionsTest-200305732 None] Copy volume to image completed successfully. Jul 17 14:22:56 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:22:56 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:56 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.428s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a 2G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a 2G" returned: 0 in 0.199s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.695s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.511s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-743149881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86efd307-389a-4dc9-9cdf-b1e1a318148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed25401f8c514f3fb2880a79a8bc43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:22:40Z,use_quota=True,user_id='1aceff6296d74fac88b8b896a50d2231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Creating volume 86efd307-389a-4dc9-9cdf-b1e1a318148a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:22:57 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:57 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a 1073741824 Jul 17 14:22:57 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-01ce76e3-f746-4cf1-ac54-45903aeff240 tempest-VolumesExtendTest-372529331 None] Extend volume completed successfully. Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-f1874abb-f067-4ff3-820e-d6b7fdbfca0a-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-f1874abb-f067-4ff3-820e-d6b7fdbfca0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:57 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a 1073741824" returned: 0 in 0.722s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-quobyte-f1874abb-f067-4ff3-820e-d6b7fdbfca0a" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-f1874abb-f067-4ff3-820e-d6b7fdbfca0a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:22:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Deleting offline snapshot f1874abb-f067-4ff3-820e-d6b7fdbfca0a of volume 0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] snapshot_file for this snap is: volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f16300-5985-4ab7-8963-ccd84e3ea8f3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:58 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a Jul 17 14:22:58 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:58 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a Jul 17 14:22:58 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:22:58 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a" returned: 0 in 0.415s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.077s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b92d985-523e-46a6-9f9b-49270e3b9d8e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070ee338-510f-4063-b293-7dc6e818b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86efd307-389a-4dc9-9cdf-b1e1a318148a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027b822-ec29-4e0e-82c6-63b760ba6bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:22:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Volume volume-86efd307-389a-4dc9-9cdf-b1e1a318148a (86efd307-389a-4dc9-9cdf-b1e1a318148a): created successfully Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027b822-ec29-4e0e-82c6-63b760ba6bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Flow 'volume_create_manager' (9615440f-7a44-4e70-b19d-436ef3e1ce80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:22:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-37b8b98d-8d57-4a2f-9158-7a9bc319d953 tempest-VolumesTransfersV355Test-1778636576 None] Created volume successfully. Jul 17 14:22:58 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c8e06cb-5791-4b25-a73e-135904c66479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:22:58 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:22:58 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e063b67-a967-48f4-a83b-f6bde3c6abb8]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:58 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:22:58 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:59 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b174c-8bd7-4249-949d-543b29d6d1c0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:59 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:22:59 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:59 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.506s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:59 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a Jul 17 14:22:59 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:59 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.524s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:59 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img Jul 17 14:22:59 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:22:59 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:22:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:22:59 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a Jul 17 14:22:59 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:00 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479.f1874abb-f067-4ff3-820e-d6b7fdbfca0a" returned: 0 in 0.816s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-f1874abb-f067-4ff3-820e-d6b7fdbfca0a" released by "_delete_snapshot" :: held 2.883s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" released by "delete_snapshot" :: held 2.943s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-63861c62-8a04-4f3a-bc5a-4c9858586509 tempest-VolumesTransfersV355Test-91738527 None] Transfer volume completed successfully. Jul 17 14:23:01 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Created reservations ['4938ec0c-6c3b-4094-b05b-3df2684bbea0', '061e8f1d-56b1-4705-9718-d1b34897efb5', '351272f2-b6d3-49a5-8b31-237f86029af6', '015cb002-2919-4a7e-bca0-c51c7e027a18'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Delete snapshot completed successfully. Jul 17 14:23:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cb8c62cb-94f8-4a80-8ff8-017b8017a32b tempest-VolumesExtendTest-372529331 None] Lock "cinder-f1874abb-f067-4ff3-820e-d6b7fdbfca0a-delete_snapshot" released by "delete_snapshot" :: held 3.815s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-0c8e06cb-5791-4b25-a73e-135904c66479-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "cinder-0c8e06cb-5791-4b25-a73e-135904c66479-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Acquiring lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" acquired by "delete_volume" :: waited 0.041s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "cinder-86efd307-389a-4dc9-9cdf-b1e1a318148a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd441d00-2d3a-46ef-abc7-879a58e742be]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-86efd307-389a-4dc9-9cdf-b1e1a318148a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:03 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:23:03 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "cinder-quobyte-86efd307-389a-4dc9-9cdf-b1e1a318148a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-quobyte-86efd307-389a-4dc9-9cdf-b1e1a318148a" acquired by "delete_volume" :: waited 0.068s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1964d955-47dd-47bf-b42d-345e8e8fdea7]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:03 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:03 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a Jul 17 14:23:03 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:03 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479 Jul 17 14:23:03 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:04 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a" returned: 0 in 1.067s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:04 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a Jul 17 14:23:04 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:04 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c8e06cb-5791-4b25-a73e-135904c66479" returned: 0 in 0.846s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "cinder-quobyte-0c8e06cb-5791-4b25-a73e-135904c66479" released by "delete_volume" :: held 1.666s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Created reservations ['787e6286-ac5c-4c0a-b521-ec5a9661c9f2', 'ef1b1554-07a6-49c2-ba30-63f478f12252', 'fe459e97-2da3-468a-aca5-b19fcbc9061d', 'c5475f4f-9501-412d-a61b-3d72fd5c4fa9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:05 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:05 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:05 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-86efd307-389a-4dc9-9cdf-b1e1a318148a" returned: 0 in 0.692s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-quobyte-86efd307-389a-4dc9-9cdf-b1e1a318148a" released by "delete_volume" :: held 1.897s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Created reservations ['5ef93eb0-3570-4cd1-b7c5-cefc85691aaa', '887f567e-096a-4a02-8c2d-7aa3007b92ae', 'd588d3b2-a13e-47ae-9b1b-94342c3f730f', '3063a1b1-e0c8-44eb-a8ed-99f35c759df6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:05 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.917s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Deleted volume successfully. Jul 17 14:23:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2451909f-4924-4591-a559-d7300073d6a2 tempest-VolumesExtendTest-372529331 None] Lock "cinder-0c8e06cb-5791-4b25-a73e-135904c66479-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:06 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:06 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:06 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img" returned: 0 in 6.629s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661e0c6-571c-47f2-b901-b6559d1bec1a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:06 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:23:06 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:06 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.272s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Deleted volume successfully. Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c19f9794-7455-4742-8b02-49f0b2dbb7a7 tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-86efd307-389a-4dc9-9cdf-b1e1a318148a-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:06 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.617s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:23:06 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Converted 1024.00 MB image at 154.44 MB/s Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] 8e5671ed-92f1-4a8b-9adb-854a152c22da was raw, converting to qcow2 {{(pid=87804) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed4e5b-00cb-4765-963e-2ab583d41ab0]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:07 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img Jul 17 14:23:07 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Flow 'volume_create_manager' (94be61db-815b-4bff-8030-aa261984ccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:07 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8aa7a4-cbc8-4bcf-adfa-2b9f3a381186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img" returned: 0 in 0.504s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8aa7a4-cbc8-4bcf-adfa-2b9f3a381186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1528904759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5e08c2-d709-4636-b250-20901007ce6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed25401f8c514f3fb2880a79a8bc43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:07Z,use_quota=True,user_id='1aceff6296d74fac88b8b896a50d2231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d04bbf-1f6f-4db3-a5c2-3479c75724ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d04bbf-1f6f-4db3-a5c2-3479c75724ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61159e5f-7ee6-4eba-b0d1-1bdc2032c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61159e5f-7ee6-4eba-b0d1-1bdc2032c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5e08c2-d709-4636-b250-20901007ce6b', 'volume_name': 'volume-9d5e08c2-d709-4636-b250-20901007ce6b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcf6969-c56b-490b-b204-923c6ea50739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcf6969-c56b-490b-b204-923c6ea50739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90789e82-5650-414a-91ea-3fc92302c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Volume 9d5e08c2-d709-4636-b250-20901007ce6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5e08c2-d709-4636-b250-20901007ce6b', 'volume_size': 1} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:07 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img Jul 17 14:23:07 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:07 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img" returned: 1 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:23:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img /opt/stack/data/cinder/conversion/vol_upload_siwabz_b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:07 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img /opt/stack/data/cinder/conversion/vol_upload_siwabz_b Jul 17 14:23:07 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:08 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img /opt/stack/data/cinder/conversion/vol_upload_siwabz_b" returned: 0 in 0.318s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:08 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Image conversion details: src /opt/stack/data/cinder/conversion/6c526f32-be51-4861-b58c-4e72060591e9.temp_image.8e5671ed-92f1-4a8b-9adb-854a152c22dabdpon120.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_siwabz_b {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:23:08 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 17 14:23:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940e34b-d3fe-412f-9c4d-fb90e376ddcd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siwabz_b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:08 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siwabz_b Jul 17 14:23:08 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:08 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_siwabz_b" returned: 0 in 0.433s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (c6c73403-15a4-4809-b556-9f612a7e022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161da4a9-2d72-4681-ae51-df1f662ec4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161da4a9-2d72-4681-ae51-df1f662ec4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18222578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8816f0d-98d2-41ce-8647-48c91527d297,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:10Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2975a25a-7cbc-4595-8705-4872e68934cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2975a25a-7cbc-4595-8705-4872e68934cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35d75d0-4528-474a-9da8-9334f6023647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35d75d0-4528-474a-9da8-9334f6023647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8816f0d-98d2-41ce-8647-48c91527d297', 'volume_name': 'volume-a8816f0d-98d2-41ce-8647-48c91527d297', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0468e8-58e6-4bf4-9d1a-964317b8f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0468e8-58e6-4bf4-9d1a-964317b8f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3264cdf-6d92-4461-90a1-51351bfcb272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Volume a8816f0d-98d2-41ce-8647-48c91527d297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8816f0d-98d2-41ce-8647-48c91527d297', 'volume_size': 1} Jul 17 14:23:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.757s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Uploaded volume to glance image-id: 8e5671ed-92f1-4a8b-9adb-854a152c22da. {{(pid=87804) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.854s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1528904759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5e08c2-d709-4636-b250-20901007ce6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed25401f8c514f3fb2880a79a8bc43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:07Z,use_quota=True,user_id='1aceff6296d74fac88b8b896a50d2231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Creating volume 9d5e08c2-d709-4636-b250-20901007ce6b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:10 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b 1073741824 Jul 17 14:23:10 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fa618e0c-739f-4a40-91fb-5a5501cc09fc tempest-VolumesActionsTest-200305732 None] Copy volume to image completed successfully. Jul 17 14:23:10 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b 1073741824" returned: 0 in 0.582s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:10 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b Jul 17 14:23:10 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:11 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18222578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8816f0d-98d2-41ce-8647-48c91527d297,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:10Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Creating volume a8816f0d-98d2-41ce-8647-48c91527d297 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:11 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:11 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 1073741824 Jul 17 14:23:11 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90789e82-5650-414a-91ea-3fc92302c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5e08c2-d709-4636-b250-20901007ce6b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2ff08f-5210-402a-b99d-90664c1f7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Volume volume-9d5e08c2-d709-4636-b250-20901007ce6b (9d5e08c2-d709-4636-b250-20901007ce6b): created successfully Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2ff08f-5210-402a-b99d-90664c1f7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Flow 'volume_create_manager' (94be61db-815b-4bff-8030-aa261984ccf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ecafc812-58c2-4a99-805d-b4e1752ea7dc tempest-VolumesTransfersV355Test-1778636576 None] Created volume successfully. Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Acquiring lock "cinder-quobyte-6c526f32-be51-4861-b58c-4e72060591e9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "cinder-quobyte-6c526f32-be51-4861-b58c-4e72060591e9" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[821fbe39-e61c-4247-b27a-2856108e149f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:11 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:23:11 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:11 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 1073741824" returned: 0 in 0.686s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 Jul 17 14:23:12 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:12 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (3c569ad8-7dbf-4b5c-ba1c-9da3efb51e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89482b6a-89ae-453d-a1ed-b5216aa03b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "cinder-9d5e08c2-d709-4636-b250-20901007ce6b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.675s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9 Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89482b6a-89ae-453d-a1ed-b5216aa03b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1987343347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e362b25c-9cdf-478e-8cbe-07d0d87cedc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:12Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5008e84b-fc02-4b4e-9df1-86308c2807d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5008e84b-fc02-4b4e-9df1-86308c2807d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc06c8ba-59c0-4192-a8ad-f503b3842353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc06c8ba-59c0-4192-a8ad-f503b3842353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e362b25c-9cdf-478e-8cbe-07d0d87cedc3', 'volume_name': 'volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c645ea8-2d01-4764-8efb-ec3f0b071a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c645ea8-2d01-4764-8efb-ec3f0b071a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6b91db-449c-4f9c-9fe7-351bf61912b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Volume e362b25c-9cdf-478e-8cbe-07d0d87cedc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3', 'volume_size': 1} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-9d5e08c2-d709-4636-b250-20901007ce6b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "cinder-quobyte-9d5e08c2-d709-4636-b250-20901007ce6b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-quobyte-9d5e08c2-d709-4636-b250-20901007ce6b" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23a840-15eb-45e7-891e-e2f727412437]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1987343347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e362b25c-9cdf-478e-8cbe-07d0d87cedc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:12Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Creating volume e362b25c-9cdf-478e-8cbe-07d0d87cedc3 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:12 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 1073741824 Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3264cdf-6d92-4461-90a1-51351bfcb272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8816f0d-98d2-41ce-8647-48c91527d297', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66525e07-26b6-401d-bfbc-7a2f50b7c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Volume volume-a8816f0d-98d2-41ce-8647-48c91527d297 (a8816f0d-98d2-41ce-8647-48c91527d297): created successfully Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66525e07-26b6-401d-bfbc-7a2f50b7c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (c6c73403-15a4-4809-b556-9f612a7e022a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:12 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c526f32-be51-4861-b58c-4e72060591e9" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-73027b83-dcaa-4044-9b1a-04df8d30279c tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "cinder-quobyte-6c526f32-be51-4861-b58c-4e72060591e9" released by "delete_volume" :: held 1.040s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:12 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b Jul 17 14:23:12 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Created reservations ['7fc6b03c-ffa3-4763-9b89-7b540e3afe8a', '6c4143d4-cf16-439c-8b8f-ef88b5512edc', '6d6a3b76-27f2-4c15-b178-4a7225f4d12c', '2dc081a6-42f6-4e6e-9d15-b2562d4ffe47'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:12 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b" returned: 0 in 0.502s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b Jul 17 14:23:12 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:12 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 1073741824" returned: 0 in 0.526s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:12 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 Jul 17 14:23:12 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:13 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.363s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Deleted volume successfully. Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-09807012-ecc3-4948-bd80-6c66150cf4a8 tempest-VolumesActionsTest-200305732 None] Lock "cinder-6c526f32-be51-4861-b58c-4e72060591e9-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:13 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-9d5e08c2-d709-4636-b250-20901007ce6b" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-quobyte-9d5e08c2-d709-4636-b250-20901007ce6b" released by "delete_volume" :: held 0.895s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Created reservations ['a6e9842d-f36e-4e38-a417-3a29b9bdd9ef', 'c5f0a29d-146f-4c9f-bfd3-85dee52736d3', '9c483867-d0a8-4b47-bd2a-0b030f6219d4', '3d098dbc-af80-491c-90d6-9db486f970ea'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:13 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6b91db-449c-4f9c-9fe7-351bf61912b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47b122a-b56d-424b-8866-62d8d24b6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Volume volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 (e362b25c-9cdf-478e-8cbe-07d0d87cedc3): created successfully Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47b122a-b56d-424b-8866-62d8d24b6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (3c569ad8-7dbf-4b5c-ba1c-9da3efb51e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-513503c6-673c-4e8a-9023-538ca1297e15 tempest-AttachVolumeNegativeTest-1859519371 None] Created volume successfully. Jul 17 14:23:13 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:13 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:13 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.262s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Deleted volume successfully. Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2eb940b6-fe24-4e4b-b65c-a04d75b0f8bf tempest-VolumesTransfersV355Test-381452599 None] Lock "cinder-9d5e08c2-d709-4636-b250-20901007ce6b-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (b17a26c2-0563-45cc-b7eb-794dab0dac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e459a4e-6007-47ba-b60d-0034a9014909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e459a4e-6007-47ba-b60d-0034a9014909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773822366',display_name='tempest-VolumesGetTest-Volume-606295549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb5fd1-8667-4891-8819-c62430f353be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:14Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b5ca77-2ad6-4975-8db0-5a645d96b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b5ca77-2ad6-4975-8db0-5a645d96b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6b3c5d-e291-43e7-95a7-11e8db586d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6b3c5d-e291-43e7-95a7-11e8db586d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcb5fd1-8667-4891-8819-c62430f353be', 'volume_name': 'volume-ebcb5fd1-8667-4891-8819-c62430f353be', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438f51e7-ab63-401c-897b-635c340c0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438f51e7-ab63-401c-897b-635c340c0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88a9ec6-85a9-4ad8-9ef0-fb3e2e3c9da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Volume ebcb5fd1-8667-4891-8819-c62430f353be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcb5fd1-8667-4891-8819-c62430f353be', 'volume_size': 1} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773822366',display_name='tempest-VolumesGetTest-Volume-606295549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb5fd1-8667-4891-8819-c62430f353be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:14Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Creating volume ebcb5fd1-8667-4891-8819-c62430f353be {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:13 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:13 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be 1073741824 Jul 17 14:23:13 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:14 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be 1073741824" returned: 0 in 0.688s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:14 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be Jul 17 14:23:14 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:15 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be" returned: 0 in 0.546s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88a9ec6-85a9-4ad8-9ef0-fb3e2e3c9da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcb5fd1-8667-4891-8819-c62430f353be', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbce6896-db71-42d3-bca9-ef2bd267940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b34f28de-f77f-4008-80a4-ffda0480095c req-f25bf605-55c6-4883-903c-7876e84cb853 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b34f28de-f77f-4008-80a4-ffda0480095c req-f25bf605-55c6-4883-903c-7876e84cb853 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b34f28de-f77f-4008-80a4-ffda0480095c req-f25bf605-55c6-4883-903c-7876e84cb853 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:15 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Volume volume-ebcb5fd1-8667-4891-8819-c62430f353be (ebcb5fd1-8667-4891-8819-c62430f353be): created successfully Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbce6896-db71-42d3-bca9-ef2bd267940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (b17a26c2-0563-45cc-b7eb-794dab0dac14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2027f898-8dda-426e-ae07-c458bd8943cb tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-b34f28de-f77f-4008-80a4-ffda0480095c req-f25bf605-55c6-4883-903c-7876e84cb853 tempest-AttachVolumeNegativeTest-1859519371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55c2bece-b7a5-442c-9a15-82c868ce5827', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:23:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-b34f28de-f77f-4008-80a4-ffda0480095c req-f25bf605-55c6-4883-903c-7876e84cb853 tempest-AttachVolumeNegativeTest-1859519371 None] attachment_update completed successfully. Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-ebcb5fd1-8667-4891-8819-c62430f353be-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "cinder-ebcb5fd1-8667-4891-8819-c62430f353be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-ebcb5fd1-8667-4891-8819-c62430f353be" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-ebcb5fd1-8667-4891-8819-c62430f353be" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e75716e-4e94-4a01-9c92-6e1cde35b49f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:16 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be Jul 17 14:23:16 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:16 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:16 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be Jul 17 14:23:16 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:17 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ebcb5fd1-8667-4891-8819-c62430f353be" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-ebcb5fd1-8667-4891-8819-c62430f353be" released by "delete_volume" :: held 0.848s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Created reservations ['2108bcd9-18e5-4863-9f49-d1d2104973f2', '4fb51db4-79e7-4252-a5d9-5d4d54fcc19b', '103baf39-50a5-46c7-a196-39af899d6514', '41506024-16fe-4635-825b-0c2f38bba9a1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:17 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:17 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-a8816f0d-98d2-41ce-8647-48c91527d297-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "cinder-a8816f0d-98d2-41ce-8647-48c91527d297-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-a8816f0d-98d2-41ce-8647-48c91527d297" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-a8816f0d-98d2-41ce-8647-48c91527d297" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:17 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.391s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e36c541-af26-4ac7-ab18-f3ab921e1345]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d076449-cb0b-41eb-bb5c-fb01179a628b tempest-VolumesGetTest-2051638299 None] Lock "cinder-ebcb5fd1-8667-4891-8819-c62430f353be-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:17 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 Jul 17 14:23:17 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:18 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297" returned: 0 in 0.503s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:18 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297 Jul 17 14:23:18 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:18 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8816f0d-98d2-41ce-8647-48c91527d297" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-a8816f0d-98d2-41ce-8647-48c91527d297" released by "delete_volume" :: held 0.954s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Created reservations ['f049295b-9481-45be-b11a-48db901e53c1', '9507f7c9-b501-4231-8c4b-fbbca99a3064', 'a33bf7ad-a82d-492e-8127-2239bb55a18e', '00ef01eb-f893-4633-a252-4628fb66910e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:18 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:18 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:19 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.301s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:19 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:23:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6dae559-f8a8-48ec-9af9-8994f3fbb544 tempest-VolumesGetTest-2051638299 None] Lock "cinder-a8816f0d-98d2-41ce-8647-48c91527d297-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (efff3c5a-fe85-4cf3-93d5-ae36b4f6752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50449c8-da7d-4b73-81a3-b15242b2d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50449c8-da7d-4b73-81a3-b15242b2d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2057835830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:21Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39aa374-920b-4b61-8b9c-26b1150f0679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39aa374-920b-4b61-8b9c-26b1150f0679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae443e64-fc76-4fb0-92c4-f3139c96cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae443e64-fc76-4fb0-92c4-f3139c96cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'volume_name': 'volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13050620-16c1-4e7c-91f6-793a678d7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13050620-16c1-4e7c-91f6-793a678d7e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bb71f8-6b9b-4f5c-8188-d6a909725c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Volume dcaa29a5-ed76-4ca9-b95a-b9b38c9489af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'volume_size': 1} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2057835830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:21Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Creating volume dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:20 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:20 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af 1073741824 Jul 17 14:23:20 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:21 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af 1073741824" returned: 0 in 0.713s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:21 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:21 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:21 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.374s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bb71f8-6b9b-4f5c-8188-d6a909725c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a91464-c36e-4dc5-aed3-0ce7153a3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Volume volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af (dcaa29a5-ed76-4ca9-b95a-b9b38c9489af): created successfully Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a91464-c36e-4dc5-aed3-0ce7153a3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (efff3c5a-fe85-4cf3-93d5-ae36b4f6752f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8691eef1-0e96-46d0-94c3-a6923f130e64 tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (9ac80bf9-b33e-4cf5-8623-fc69eabee6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1014c1-2cc6-4a9d-8b2a-5f2d1f386f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1014c1-2cc6-4a9d-8b2a-5f2d1f386f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1059049820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90971f6-1d4a-402d-8668-8e29b1a65b1c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:23Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ce7e9f-9dcd-4588-9faa-95b4812f1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ce7e9f-9dcd-4588-9faa-95b4812f1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fdd883-657f-4eb3-9cd0-7677246fc98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fdd883-657f-4eb3-9cd0-7677246fc98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f90971f6-1d4a-402d-8668-8e29b1a65b1c', 'volume_name': 'volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c', 'volume_size': 1, 'source_volid': 'dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'source_volstatus': 'available'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc85d919-82a6-485d-a3c6-e6e9ea18ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc85d919-82a6-485d-a3c6-e6e9ea18ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919ba5d3-1f73-45d3-ae20-e8afb6dffcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:23 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Volume f90971f6-1d4a-402d-8668-8e29b1a65b1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c', 'volume_size': 1, 'source_volid': 'dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'source_volstatus': 'available'} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:23 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Cloning volume dcaa29a5-ed76-4ca9-b95a-b9b38c9489af to volume f90971f6-1d4a-402d-8668-8e29b1a65b1c Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Flow 'volume_create_manager' (52ed8d1c-6988-4a94-bc04-d54c2464d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae8cac-c6f8-485a-a25f-c4005c907b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aae8cac-c6f8-485a-a25f-c4005c907b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-459348717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b581d318-7ee5-48fd-9b89-a40ff8d984ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dfab1fb57d4d0989e1a54295b19604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:24Z,use_quota=True,user_id='88e3093b782940b6a093dc58efcd7396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3169f07-1f38-4fd5-ac5f-b4097cae222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3169f07-1f38-4fd5-ac5f-b4097cae222b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503d1d7-1e85-42a6-b63e-2564a153090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503d1d7-1e85-42a6-b63e-2564a153090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b581d318-7ee5-48fd-9b89-a40ff8d984ae', 'volume_name': 'volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3bb2f7-f169-4756-9c37-ec1117513654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3bb2f7-f169-4756-9c37-ec1117513654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5cb109-3bf9-4fd9-ae39-6dae9a37ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Volume b581d318-7ee5-48fd-9b89-a40ff8d984ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae', 'volume_size': 1} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Creating offline snapshot 6ee8100b-896c-4e64-be42-7fd5a431e998 of volume dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ed18fb-b8c4-49e0-9c46-614dc6c56f7c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:24 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:24 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Flow 'volume_create_manager' (00468912-20dc-47ba-8008-0e1bdda9276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c8e870-19ce-42ab-9ef4-98cd86af72aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c8e870-19ce-42ab-9ef4-98cd86af72aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1933568292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff43d65-dc85-447e-b8e1-9c756b6f6b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fb31d982534f35b98fcda450ec4d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:24Z,use_quota=True,user_id='987ec033e4c3431ea9ed47e4eca890f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5fc23-0dc7-4dca-8315-9cf81bdb8ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5fc23-0dc7-4dca-8315-9cf81bdb8ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9350a878-86e0-4f96-990c-f3ffe0b8707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9350a878-86e0-4f96-990c-f3ffe0b8707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff43d65-dc85-447e-b8e1-9c756b6f6b75', 'volume_name': 'volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75', 'volume_size': 2}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3c9668-4f7f-463f-968c-489ed8dad0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3c9668-4f7f-463f-968c-489ed8dad0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb53e4a-8684-4922-a0ed-8027a2a6252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:24 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Volume 0ff43d65-dc85-447e-b8e1-9c756b6f6b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75', 'volume_size': 2} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:24 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.525s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:24 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 1G Jul 17 14:23:24 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:25 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 1G" returned: 0 in 0.592s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:25 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:25 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:25 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.300s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:25 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 is being set with open permissions: ugo+rw Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:25 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:25 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:25 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:25 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:25 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:25 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info Jul 17 14:23:25 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:26 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:23:26 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info" returned: 0 in 0.335s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:26 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info is being set with open permissions: ugo+rw Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:26 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info Jul 17 14:23:26 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:26 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.info" returned: 0 in 0.292s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] snapshot: 6ee8100b-896c-4e64-be42-7fd5a431e998, volume: f90971f6-1d4a-402d-8668-8e29b1a65b1c, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5c764-6a73-4e12-81f4-d01f78699cd9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:26 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:26 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:26 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.387s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8887abd7-ea93-4201-9c14-e06bd71ed268]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:27 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:27 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:27 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:23:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:27 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c Jul 17 14:23:27 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:34 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c" returned: 0 in 6.691s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd427d-ec70-40eb-9ae2-ccda755d0b70]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:34 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:34 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:35 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.687s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:23:35 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Converted 1024.00 MB image at 153.01 MB/s Jul 17 14:23:35 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c is being set with open permissions: ugo+rw Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:35 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c Jul 17 14:23:35 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:35 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c" returned: 0 in 0.290s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" released by "_copy_volume_from_snapshot" :: held 8.775s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-6ee8100b-896c-4e64-be42-7fd5a431e998" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-6ee8100b-896c-4e64-be42-7fd5a431e998" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Deleting offline snapshot 6ee8100b-896c-4e64-be42-7fd5a431e998 of volume dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] snapshot_file for this snap is: volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6898ae7c-5416-432b-b506-86fb03803498]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:35 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:35 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:35 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.397s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1d476-6c79-4186-8766-98b0831c1118]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:35 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=64,cinder:UPDATE=89,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:23:35 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:35 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:36 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:36 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:36 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:36 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:36 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998 Jul 17 14:23:36 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:36 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af.6ee8100b-896c-4e64-be42-7fd5a431e998" returned: 0 in 0.237s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-6ee8100b-896c-4e64-be42-7fd5a431e998" released by "_delete_snapshot" :: held 1.448s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.960s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.829s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-459348717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b581d318-7ee5-48fd-9b89-a40ff8d984ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dfab1fb57d4d0989e1a54295b19604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:24Z,use_quota=True,user_id='88e3093b782940b6a093dc58efcd7396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Creating volume b581d318-7ee5-48fd-9b89-a40ff8d984ae {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:36 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:36 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae 1073741824 Jul 17 14:23:36 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919ba5d3-1f73-45d3-ae20-e8afb6dffcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c', 'volume_size': 1, 'source_volid': 'dcaa29a5-ed76-4ca9-b95a-b9b38c9489af', 'source_volstatus': 'available'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b55394-460d-4eb9-bfa2-3822c763fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Volume volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c (f90971f6-1d4a-402d-8668-8e29b1a65b1c): created successfully Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b55394-460d-4eb9-bfa2-3822c763fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (9ac80bf9-b33e-4cf5-8623-fc69eabee6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cbbdf9ce-2506-4550-b2ee-6ff455f8c354 tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:37 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae 1073741824" returned: 0 in 0.537s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:37 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae Jul 17 14:23:37 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:37 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.358s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1933568292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff43d65-dc85-447e-b8e1-9c756b6f6b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fb31d982534f35b98fcda450ec4d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:24Z,use_quota=True,user_id='987ec033e4c3431ea9ed47e4eca890f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Creating volume 0ff43d65-dc85-447e-b8e1-9c756b6f6b75 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:37 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 2147483648 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5cb109-3bf9-4fd9-ae39-6dae9a37ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302de347-e7d4-4052-b40b-c853fbe2821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:37 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 2147483648 Jul 17 14:23:37 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Volume volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae (b581d318-7ee5-48fd-9b89-a40ff8d984ae): created successfully Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302de347-e7d4-4052-b40b-c853fbe2821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Flow 'volume_create_manager' (52ed8d1c-6988-4a94-bc04-d54c2464d39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b065b843-cff7-4a2c-9a0a-8eb27bf93c9a tempest-VolumesNegativeTest-36657686 None] Created volume successfully. Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (02c67001-65a9-4500-9c89-5e0b61761c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0479b28-5e25-4ecf-ba73-2d94be78aeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0479b28-5e25-4ecf-ba73-2d94be78aeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1914272896',display_name='tempest-VolumesGetTest-Volume-2107548400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca5c026-5559-4f38-b0c9-c25d7378bf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:38Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f70023-0fb9-4b37-b71e-c42b1e4dead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f70023-0fb9-4b37-b71e-c42b1e4dead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085f356-d482-4600-a460-4010f6d8af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085f356-d482-4600-a460-4010f6d8af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca5c026-5559-4f38-b0c9-c25d7378bf5a', 'volume_name': 'volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b87545-b1fb-4221-a599-1e10b07a3ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b87545-b1fb-4221-a599-1e10b07a3ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47aeae6-b144-4732-b8df-9ca456dca021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Volume 8ca5c026-5559-4f38-b0c9-c25d7378bf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a', 'volume_size': 1} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:38 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 2147483648" returned: 0 in 0.597s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:38 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 Jul 17 14:23:38 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:38 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1914272896',display_name='tempest-VolumesGetTest-Volume-2107548400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca5c026-5559-4f38-b0c9-c25d7378bf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:38Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Creating volume 8ca5c026-5559-4f38-b0c9-c25d7378bf5a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:38 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:38 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a 1073741824 Jul 17 14:23:38 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb53e4a-8684-4922-a0ed-8027a2a6252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75', 'volume_size': 2}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3306cbc2-203f-4788-bc09-c74f1389c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:38 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Volume volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 (0ff43d65-dc85-447e-b8e1-9c756b6f6b75): created successfully Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3306cbc2-203f-4788-bc09-c74f1389c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Flow 'volume_create_manager' (00468912-20dc-47ba-8008-0e1bdda9276e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6cd54066-0a43-4f67-89b0-bd862e883045 tempest-VolumesCloneNegativeTest-608995943 None] Created volume successfully. Jul 17 14:23:39 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a 1073741824" returned: 0 in 0.649s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:39 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a Jul 17 14:23:39 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Acquiring lock "cinder-0ff43d65-dc85-447e-b8e1-9c756b6f6b75-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "cinder-0ff43d65-dc85-447e-b8e1-9c756b6f6b75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Acquiring lock "cinder-quobyte-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "cinder-quobyte-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[32017421-73af-49b3-b23f-44c2d3972d7c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:39 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 Jul 17 14:23:39 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:39 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" returned: 0 in 0.406s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47aeae6-b144-4732-b8df-9ca456dca021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6165123-0b4c-426e-8388-7dc80e564b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:39 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Volume volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a (8ca5c026-5559-4f38-b0c9-c25d7378bf5a): created successfully Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6165123-0b4c-426e-8388-7dc80e564b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (02c67001-65a9-4500-9c89-5e0b61761c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5bfe6834-91f5-4a19-a63b-a5bce7331adb tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:40 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" returned: 0 in 0.530s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:40 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75 Jul 17 14:23:40 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:40 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" returned: 0 in 0.369s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "cinder-quobyte-0ff43d65-dc85-447e-b8e1-9c756b6f6b75" released by "delete_volume" :: held 0.981s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-8ca5c026-5559-4f38-b0c9-c25d7378bf5a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "cinder-8ca5c026-5559-4f38-b0c9-c25d7378bf5a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Created reservations ['8242ab3e-c915-4f55-adc0-17ee70f56316', '07f88919-368c-4f16-83f8-80d7a8e5cf65', 'd4335c63-0150-4c9c-b525-413b2fb2f23a', 'd1401b84-7565-4e4d-b746-3fb62c3feac1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e83fd-f85f-4f2f-81b1-ffce17fd3de1]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:41 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:41 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:41 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a Jul 17 14:23:41 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:41 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.380s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Deleted volume successfully. Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-74e1955b-62b4-4c3e-9ca9-728e6755ed54 tempest-VolumesCloneNegativeTest-608995943 None] Lock "cinder-0ff43d65-dc85-447e-b8e1-9c756b6f6b75-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:41 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" returned: 0 in 0.578s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:41 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a Jul 17 14:23:41 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:41 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-8ca5c026-5559-4f38-b0c9-c25d7378bf5a" released by "delete_volume" :: held 1.002s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Created reservations ['9500d00d-168b-43ec-bcee-5d96e09a96c9', '3d3e0fdc-f07e-421a-a51c-21fde5726406', 'c1fb3f5d-b320-4e14-ab41-ec71c7ff0bb9', '81d8e855-8c26-41d9-8ce1-006da408514c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:42 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:42 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:42 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.384s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:23:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ecadb2d4-e2d3-4fa2-b9c2-73d57a6bd54c tempest-VolumesGetTest-2051638299 None] Lock "cinder-8ca5c026-5559-4f38-b0c9-c25d7378bf5a-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-f90971f6-1d4a-402d-8668-8e29b1a65b1c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "cinder-f90971f6-1d4a-402d-8668-8e29b1a65b1c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24da37e-8c63-4fde-9dca-2369b44f16a5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:43 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c Jul 17 14:23:43 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:43 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:43 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c Jul 17 14:23:43 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:44 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f90971f6-1d4a-402d-8668-8e29b1a65b1c" returned: 0 in 0.345s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-f90971f6-1d4a-402d-8668-8e29b1a65b1c" released by "delete_volume" :: held 0.897s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Created reservations ['bbac1005-a97e-47d1-a2a3-d2f408afd15f', 'b656b81d-578c-48da-9a05-ff08d94fed43', '27fd3c47-46e0-48ff-ae49-49c3f8427148', '1066a4b4-e0e6-4dd9-996c-b927ea31999e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:44 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:44 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "cinder-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" acquired by "delete_volume" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45d6cb-ac23-47b1-8769-55ce65d110e6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:44 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.375s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:23:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d31f1182-9600-4f58-b336-f69c50b157a2 tempest-VolumesGetTest-2051638299 None] Lock "cinder-f90971f6-1d4a-402d-8668-8e29b1a65b1c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:44 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:44 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:45 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.522s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:45 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af Jul 17 14:23:45 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:45 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" returned: 0 in 0.324s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af" released by "delete_volume" :: held 0.931s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Created reservations ['8361a400-d5ac-4827-bec1-fba3d32321c6', '479c7e9e-e58e-437e-85a3-317be091dd82', '0f216492-a0aa-47de-b93c-a596c2dcecde', 'e1b24624-72c9-4270-a4db-c319cd56ec99'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:45 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:23:45 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:46 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.440s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:46 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:23:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:23:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-89bb02a0-4107-45b4-b7a2-bbf99905b9e0 tempest-VolumesGetTest-2051638299 None] Lock "cinder-dcaa29a5-ed76-4ca9-b95a-b9b38c9489af-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (bee553cb-5575-4a07-abdf-965c4dc61d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a761529-ce78-443e-912f-3931a16c7752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a761529-ce78-443e-912f-3931a16c7752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-741700777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df1bb7f-705c-46e0-82cd-79e51424088f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:48Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b465bd-2e4a-4c92-9395-c673d77a7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b465bd-2e4a-4c92-9395-c673d77a7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d096db5c-cc01-4f63-a34a-1d4903c1ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:48 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d096db5c-cc01-4f63-a34a-1d4903c1ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5df1bb7f-705c-46e0-82cd-79e51424088f', 'volume_name': 'volume-5df1bb7f-705c-46e0-82cd-79e51424088f', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dd89e1-30d8-4a96-9446-c38127974a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dd89e1-30d8-4a96-9446-c38127974a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d057665b-54df-414e-bb98-2b3e4112c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Volume 5df1bb7f-705c-46e0-82cd-79e51424088f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5df1bb7f-705c-46e0-82cd-79e51424088f', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Trying to clone 5df1bb7f-705c-46e0-82cd-79e51424088f from image fe33b284-d390-4ad6-9a67-4047a22fe63a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:23:49 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Image download 20.69 MB at 20.69 MB/s Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1a3ce-5e66-4327-a6b0-010f7f5e1f82]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:50 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD Jul 17 14:23:50 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:50 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:50 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a is fetched for user fb3d1c284fd341deaea7576fec5177dc. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:23:50 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d197421-8f97-4c08-8629-671307e79cee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:50 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD Jul 17 14:23:50 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:51 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-741700777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df1bb7f-705c-46e0-82cd-79e51424088f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:48Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Creating volume 5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:51 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:51 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1073741824 Jul 17 14:23:51 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:52 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1073741824" returned: 0 in 0.735s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=88,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=12 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:52 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f Jul 17 14:23:52 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:52 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f" returned: 0 in 0.482s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Attempting download of fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume 5df1bb7f-705c-46e0-82cd-79e51424088f. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c37126-d917-49b7-ac1f-89ae2c25f974]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:52 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx Jul 17 14:23:52 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:53 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx" returned: 0 in 0.550s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:53 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx Jul 17 14:23:53 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:53 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx" returned: 1 in 0.460s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_iioyldlx' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e492b-23c6-4642-bbf2-b0aa6eef7ef2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:23:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:53 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD Jul 17 14:23:53 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:54 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:54 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] fe33b284-d390-4ad6-9a67-4047a22fe63a was qcow2, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:23:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:54 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f Jul 17 14:23:54 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:56 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f" returned: 0 in 2.682s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:56 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mxrpyfcwdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:23:56 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Converted 112.00 MB image at 41.72 MB/s Jul 17 14:23:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:56 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1G Jul 17 14:23:56 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:23:57 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f 1G" returned: 0 in 0.582s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Downloaded image fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume 5df1bb7f-705c-46e0-82cd-79e51424088f successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a for user fb3d1c284fd341deaea7576fec5177dc is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Marking volume 5df1bb7f-705c-46e0-82cd-79e51424088f as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Copying metadata from image fe33b284-d390-4ad6-9a67-4047a22fe63a to 5df1bb7f-705c-46e0-82cd-79e51424088f. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Creating volume glance metadata for volume 5df1bb7f-705c-46e0-82cd-79e51424088f backed by image fe33b284-d390-4ad6-9a67-4047a22fe63a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d057665b-54df-414e-bb98-2b3e4112c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df1bb7f-705c-46e0-82cd-79e51424088f', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e836d07-d3e5-4c0a-a1a5-2e3a5c9a9fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:57 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Volume volume-5df1bb7f-705c-46e0-82cd-79e51424088f (5df1bb7f-705c-46e0-82cd-79e51424088f): created successfully Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e836d07-d3e5-4c0a-a1a5-2e3a5c9a9fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (bee553cb-5575-4a07-abdf-965c4dc61d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-41574e7a-c50f-428f-bfb9-7f5decce458d tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (075040e5-231c-4963-b05a-0d1484ca7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694f974a-646a-4d37-aca8-350b0dca82e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694f974a-646a-4d37-aca8-350b0dca82e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1327576850',display_name='tempest-VolumesGetTest-Volume-148421707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c9e35f-786b-4366-acd3-bdd55e6c27fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:59Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba266fb-8468-44e0-b58c-46e802098cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba266fb-8468-44e0-b58c-46e802098cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9792cd2-48f2-429b-86ab-c9958c8f0827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9792cd2-48f2-429b-86ab-c9958c8f0827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c9e35f-786b-4366-acd3-bdd55e6c27fb', 'volume_name': 'volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0308235-6149-417d-acbd-b52da7d89adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0308235-6149-417d-acbd-b52da7d89adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa478349-bee2-41c7-81f9-0c8febbff39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:23:59 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Volume a8c9e35f-786b-4366-acd3-bdd55e6c27fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb', 'volume_size': 1} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:23:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1327576850',display_name='tempest-VolumesGetTest-Volume-148421707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c9e35f-786b-4366-acd3-bdd55e6c27fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c4ffca4b4eee84facb4a96d17721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:23:59Z,use_quota=True,user_id='fb3d1c284fd341deaea7576fec5177dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Creating volume a8c9e35f-786b-4366-acd3-bdd55e6c27fb {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:23:59 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:23:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:23:59 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb 1073741824 Jul 17 14:23:59 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:00 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb 1073741824" returned: 0 in 0.686s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:00 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb Jul 17 14:24:00 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:00 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" returned: 0 in 0.375s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa478349-bee2-41c7-81f9-0c8febbff39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dae1b7d-bd5e-4ed7-a882-52961993fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:00 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Volume volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb (a8c9e35f-786b-4366-acd3-bdd55e6c27fb): created successfully Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dae1b7d-bd5e-4ed7-a882-52961993fb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Flow 'volume_create_manager' (075040e5-231c-4963-b05a-0d1484ca7357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9ef549fc-29f9-4453-abda-695073f42898 tempest-VolumesGetTest-2051638299 None] Created volume successfully. Jul 17 14:24:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-f28b5954-da77-42d0-a2c9-b470fdf38c32 req-a509aed6-29a5-4bae-a6ed-fab3f0e768b5 tempest-AttachVolumeNegativeTest-1859519371 None] Terminate volume connection completed successfully. Jul 17 14:24:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-f28b5954-da77-42d0-a2c9-b470fdf38c32 req-a509aed6-29a5-4bae-a6ed-fab3f0e768b5 tempest-AttachVolumeNegativeTest-1859519371 None] Deleting attachment 55c2bece-b7a5-442c-9a15-82c868ce5827. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:24:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-a8c9e35f-786b-4366-acd3-bdd55e6c27fb-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "cinder-a8c9e35f-786b-4366-acd3-bdd55e6c27fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[70314a2c-e360-49d7-ba38-9c425ca8c3ea]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:02 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb Jul 17 14:24:02 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:02 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" returned: 0 in 0.636s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:02 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb Jul 17 14:24:02 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:03 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" returned: 0 in 0.642s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-a8c9e35f-786b-4366-acd3-bdd55e6c27fb" released by "delete_volume" :: held 1.386s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Created reservations ['48e36bcb-a1bc-4809-a2b4-b760725e71fa', '9dd4cc75-8995-44f0-8a86-442c3942d689', '2a063ebc-6ae0-4490-88ab-9e5e64b04e5d', 'e12c61a8-74b4-4d26-9d74-33a49a728383'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:03 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:24:03 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:04 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.483s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:24:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-427723d8-830d-4c43-99f9-c64578c7b62c tempest-VolumesGetTest-2051638299 None] Lock "cinder-a8c9e35f-786b-4366-acd3-bdd55e6c27fb-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-5df1bb7f-705c-46e0-82cd-79e51424088f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "cinder-5df1bb7f-705c-46e0-82cd-79e51424088f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Acquiring lock "cinder-quobyte-5df1bb7f-705c-46e0-82cd-79e51424088f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-5df1bb7f-705c-46e0-82cd-79e51424088f" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[95381a2b-f330-467b-bba1-10a4cd8b43dc]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Acquiring lock "cinder-b581d318-7ee5-48fd-9b89-a40ff8d984ae-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "cinder-b581d318-7ee5-48fd-9b89-a40ff8d984ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Acquiring lock "cinder-quobyte-b581d318-7ee5-48fd-9b89-a40ff8d984ae" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:24:05 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f Jul 17 14:24:05 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "cinder-quobyte-b581d318-7ee5-48fd-9b89-a40ff8d984ae" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a508c54-dd3f-46eb-9c78-e7f0e93274d5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:05 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae Jul 17 14:24:05 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:05 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f" returned: 0 in 0.591s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:05 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f Jul 17 14:24:05 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:05 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae" returned: 0 in 0.576s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:05 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae Jul 17 14:24:05 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:05 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5df1bb7f-705c-46e0-82cd-79e51424088f" returned: 0 in 0.514s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "cinder-quobyte-5df1bb7f-705c-46e0-82cd-79e51424088f" released by "delete_volume" :: held 1.191s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:06 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b581d318-7ee5-48fd-9b89-a40ff8d984ae" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "cinder-quobyte-b581d318-7ee5-48fd-9b89-a40ff8d984ae" released by "delete_volume" :: held 1.076s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Created reservations ['d729d3f3-dfa9-4403-ab83-50ec170a5cdf', '4b7892ec-6368-4e5f-9c8c-9bd86752907d', 'a4434344-2d8d-4a40-b5e7-d40588530b9f', '70e8d322-ff4c-41c1-823c-b95e54686fa9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Created reservations ['67e01ca6-f4fd-4749-aa21-3aa98b7de62c', '2765f1b7-e2f1-475c-9282-2a0f28343eb3', 'eafd6b19-c662-4931-a84c-85260101bfb5', 'f1b1f7bc-c9e2-4618-b527-320c4fa9406f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:06 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:24:06 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:06 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:24:06 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:06 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.370s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:24:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Deleted volume successfully. Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1eb59659-4d1a-4c02-afbc-0a477176be99 tempest-VolumesGetTest-2051638299 None] Lock "cinder-5df1bb7f-705c-46e0-82cd-79e51424088f-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:06 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.345s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:24:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Deleted volume successfully. Jul 17 14:24:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-96afd3eb-8728-4494-835c-e9aa7b9e8f1f tempest-VolumesNegativeTest-36657686 None] Lock "cinder-b581d318-7ee5-48fd-9b89-a40ff8d984ae-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:24:16 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=77,cinder:INSERT=20,cinder:SELECT=56,cinder:DELETE=7 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:24:16 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=29,cinder:SELECT=25,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:25 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:24:25 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:26 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:24:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:24:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:24:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (0e5bf083-cad6-4c20-a9c4-866cfb1f6905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f060467e-1cac-4625-a6d6-341e6fab8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f060467e-1cac-4625-a6d6-341e6fab8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1780510178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9aaab54-6888-4a7f-9c24-f770d6ae6b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:36Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0807d9cd-1bd0-41b2-9ce0-5bc62bf48f11),volume_type_id=0807d9cd-1bd0-41b2-9ce0-5bc62bf48f11)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a59f86b-90c2-463f-b7e4-7c2a2501832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a59f86b-90c2-463f-b7e4-7c2a2501832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c0cf86-100a-491d-a658-e018635a98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c0cf86-100a-491d-a658-e018635a98ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9aaab54-6888-4a7f-9c24-f770d6ae6b02', 'volume_name': 'volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a708c-0b63-4670-a3c7-2b68cef2d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a708c-0b63-4670-a3c7-2b68cef2d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a912417-43f7-497e-a378-be53c28a7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:35 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume e9aaab54-6888-4a7f-9c24-f770d6ae6b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02', 'volume_size': 1} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1780510178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9aaab54-6888-4a7f-9c24-f770d6ae6b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:36Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0807d9cd-1bd0-41b2-9ce0-5bc62bf48f11),volume_type_id=0807d9cd-1bd0-41b2-9ce0-5bc62bf48f11)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Creating volume e9aaab54-6888-4a7f-9c24-f770d6ae6b02 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:24:35 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:24:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:35 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 1073741824 Jul 17 14:24:35 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (9c6349fe-5dd3-4aec-8286-987639133cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8862d3af-ffc9-482c-84cf-87b5543927d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8862d3af-ffc9-482c-84cf-87b5543927d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-205499785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4cbd6d-52e3-48fc-83fe-c05031db757d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:36Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab1249f6-c9cb-4b5b-bcc0-b19bfdf7d053),volume_type_id=ab1249f6-c9cb-4b5b-bcc0-b19bfdf7d053)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6fd35b-081e-4b02-93e9-db7d5a1f2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6fd35b-081e-4b02-93e9-db7d5a1f2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a221b40e-0fa0-48be-b887-bf6dc79f1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a221b40e-0fa0-48be-b887-bf6dc79f1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4cbd6d-52e3-48fc-83fe-c05031db757d', 'volume_name': 'volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b85a6-ea3b-4202-847e-51d4be77f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b85a6-ea3b-4202-847e-51d4be77f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fe73a7-c463-4ff5-a3ad-cb66e42d8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume aa4cbd6d-52e3-48fc-83fe-c05031db757d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d', 'volume_size': 1} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:36 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 1073741824" returned: 0 in 0.770s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:36 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 Jul 17 14:24:36 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:37 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" returned: 0 in 0.345s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-205499785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4cbd6d-52e3-48fc-83fe-c05031db757d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:36Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab1249f6-c9cb-4b5b-bcc0-b19bfdf7d053),volume_type_id=ab1249f6-c9cb-4b5b-bcc0-b19bfdf7d053)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Creating volume aa4cbd6d-52e3-48fc-83fe-c05031db757d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:24:37 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a912417-43f7-497e-a378-be53c28a7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d 1073741824 Jul 17 14:24:37 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c091f-c288-476f-96ad-db331a694deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 (e9aaab54-6888-4a7f-9c24-f770d6ae6b02): created successfully Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c091f-c288-476f-96ad-db331a694deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (0e5bf083-cad6-4c20-a9c4-866cfb1f6905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (0ab857db-9931-4296-9d6d-61d0d785410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb34d1-9ece-4ab0-91e9-76eec2fe26cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e183ca6f-f608-422e-a86b-34900be19ec9 tempest-TestInstancesWithCinderVolumes-2013011046 None] Created volume successfully. Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb34d1-9ece-4ab0-91e9-76eec2fe26cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1317186615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db039b1-accf-441a-af7d-fad26c770e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:37Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34af3492-455f-4317-8ca0-2e3afe79ab26),volume_type_id=34af3492-455f-4317-8ca0-2e3afe79ab26)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9494b0-ae22-4302-b128-79805f7f8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9494b0-ae22-4302-b128-79805f7f8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538e250a-7346-46de-8e4c-6a107d2bd0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538e250a-7346-46de-8e4c-6a107d2bd0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4db039b1-accf-441a-af7d-fad26c770e62', 'volume_name': 'volume-4db039b1-accf-441a-af7d-fad26c770e62', 'volume_size': 1, 'image_id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--529536553', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84fd597d5e564eb1a6a42f63ae9e5f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'created_at': datetime.datetime(2026, 7, 17, 12, 24, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 24, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb96a205-b354-4d61-86c0-b29ba8409369/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33924f2-bf09-4432-8928-0d9824156522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33924f2-bf09-4432-8928-0d9824156522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0432b4e-1547-4414-926c-cb29b7c0f4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume 4db039b1-accf-441a-af7d-fad26c770e62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4db039b1-accf-441a-af7d-fad26c770e62', 'volume_size': 1, 'image_id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--529536553', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84fd597d5e564eb1a6a42f63ae9e5f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'created_at': datetime.datetime(2026, 7, 17, 12, 24, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 24, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb96a205-b354-4d61-86c0-b29ba8409369/file', 'properties': {}}, 'image_service': } Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Trying to clone 4db039b1-accf-441a-af7d-fad26c770e62 from image cb96a205-b354-4d61-86c0-b29ba8409369 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:24:37 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d 1073741824" returned: 0 in 0.680s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:37 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d Jul 17 14:24:37 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:38 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d" returned: 0 in 0.436s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fe73a7-c463-4ff5-a3ad-cb66e42d8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a1c2e3-b921-4e84-aa14-fe33a93397ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:38 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d (aa4cbd6d-52e3-48fc-83fe-c05031db757d): created successfully Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a1c2e3-b921-4e84-aa14-fe33a93397ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:38 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (9c6349fe-5dd3-4aec-8286-987639133cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5f608476-9c3a-4292-a7cf-ad1a5266beae tempest-TestInstancesWithCinderVolumes-2013011046 None] Created volume successfully. Jul 17 14:24:41 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD, size 20.69 MB, duration 4.01 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:24:41 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Image download 20.69 MB at 5.16 MB/s Jul 17 14:24:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b185ea-068d-4570-a864-f532b850256c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:41 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD Jul 17 14:24:41 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:42 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Temporary image cb96a205-b354-4d61-86c0-b29ba8409369 is fetched for user ccc52396ef724cc68ffe456cad32ffde. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[08819a0b-9d47-4d97-ac9f-5ad66cabcb86]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:42 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD Jul 17 14:24:42 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:42 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1317186615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db039b1-accf-441a-af7d-fad26c770e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd597d5e564eb1a6a42f63ae9e5f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:37Z,use_quota=True,user_id='ccc52396ef724cc68ffe456cad32ffde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34af3492-455f-4317-8ca0-2e3afe79ab26),volume_type_id=34af3492-455f-4317-8ca0-2e3afe79ab26)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Creating volume 4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:24:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:24:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:42 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1073741824 Jul 17 14:24:42 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:43 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1073741824" returned: 0 in 0.566s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:43 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 Jul 17 14:24:43 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:43 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Attempting download of cb96a205-b354-4d61-86c0-b29ba8409369 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}])) to volume 4db039b1-accf-441a-af7d-fad26c770e62. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a0cb4d-c477-4dc1-bd50-b1c7a5ff8283]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:44 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i Jul 17 14:24:44 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:44 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:44 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i Jul 17 14:24:44 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:44 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i" returned: 1 in 0.460s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb96a205-b354-4d61-86c0-b29ba8409369_bkzlfx5i' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca18a0-ea00-440f-a7f6-2076c4b7a723]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:24:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:44 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD Jul 17 14:24:44 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:45 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:45 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] cb96a205-b354-4d61-86c0-b29ba8409369 was qcow2, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:24:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:45 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 Jul 17 14:24:45 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:48 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62" returned: 0 in 3.211s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:48 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb96a205-b354-4d61-86c0-b29ba8409369_0zb_35zqdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:24:48 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Converted 112.00 MB image at 34.84 MB/s Jul 17 14:24:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:48 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1G Jul 17 14:24:48 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:49 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 1G" returned: 0 in 0.506s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Downloaded image cb96a205-b354-4d61-86c0-b29ba8409369 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}])) to volume 4db039b1-accf-441a-af7d-fad26c770e62 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Temporary image cb96a205-b354-4d61-86c0-b29ba8409369 for user ccc52396ef724cc68ffe456cad32ffde is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Marking volume 4db039b1-accf-441a-af7d-fad26c770e62 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Copying metadata from image cb96a205-b354-4d61-86c0-b29ba8409369 to 4db039b1-accf-441a-af7d-fad26c770e62. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Creating volume glance metadata for volume 4db039b1-accf-441a-af7d-fad26c770e62 backed by image cb96a205-b354-4d61-86c0-b29ba8409369 with: {'image_id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'image_name': 'tempest-scenario-img--529536553', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0432b4e-1547-4414-926c-cb29b7c0f4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db039b1-accf-441a-af7d-fad26c770e62', 'volume_size': 1, 'image_id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb96a205-b354-4d61-86c0-b29ba8409369', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--529536553', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84fd597d5e564eb1a6a42f63ae9e5f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb96a205-b354-4d61-86c0-b29ba8409369', 'created_at': datetime.datetime(2026, 7, 17, 12, 24, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 24, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb96a205-b354-4d61-86c0-b29ba8409369/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd5459a-ef4f-42f3-8efd-3960f1c78a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Volume volume-4db039b1-accf-441a-af7d-fad26c770e62 (4db039b1-accf-441a-af7d-fad26c770e62): created successfully Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd5459a-ef4f-42f3-8efd-3960f1c78a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Flow 'volume_create_manager' (0ab857db-9931-4296-9d6d-61d0d785410e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4fee1540-b1c8-4460-a1dd-8d61d7ac3d7b tempest-TestInstancesWithCinderVolumes-2013011046 None] Created volume successfully. Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Flow 'volume_create_manager' (2b7ed45c-242f-401e-b918-97a1ff10507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8c9737-2dba-4852-8148-5e2e595365cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8c9737-2dba-4852-8148-5e2e595365cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1512770449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6201e8ac-1c7c-4db3-a3e1-75a68428622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04c13051dc4ee1940982fb1505cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:54Z,use_quota=True,user_id='14cefa6bf84046b68c925c224292dc8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd588ee2-4900-4f6f-a608-dc4952e29a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd588ee2-4900-4f6f-a608-dc4952e29a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c79c68-39f2-4fc7-9a00-b7f39a95ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c79c68-39f2-4fc7-9a00-b7f39a95ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6201e8ac-1c7c-4db3-a3e1-75a68428622b', 'volume_name': 'volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19f8ae8-4d5a-4d2a-9ace-9df96aaf242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19f8ae8-4d5a-4d2a-9ace-9df96aaf242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6269a555-3c9e-4334-8144-6b57ef241664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:53 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume 6201e8ac-1c7c-4db3-a3e1-75a68428622b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b', 'volume_size': 1} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1512770449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6201e8ac-1c7c-4db3-a3e1-75a68428622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04c13051dc4ee1940982fb1505cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:54Z,use_quota=True,user_id='14cefa6bf84046b68c925c224292dc8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Creating volume 6201e8ac-1c7c-4db3-a3e1-75a68428622b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:24:53 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:24:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:53 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b 1073741824 Jul 17 14:24:53 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:54 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b 1073741824" returned: 0 in 1.101s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:54 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b Jul 17 14:24:54 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Flow 'volume_create_manager' (dc6da993-828c-4be5-b901-2ba99f62b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd9107d-7a52-47a8-8329-a53d82526858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd9107d-7a52-47a8-8329-a53d82526858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1571815820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb12c9-62b1-4ba8-aa4f-278de167d0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04c13051dc4ee1940982fb1505cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:55Z,use_quota=True,user_id='14cefa6bf84046b68c925c224292dc8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e79fec-dabe-4ed3-bf63-75522a0f08f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e79fec-dabe-4ed3-bf63-75522a0f08f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973be82c-9862-44ad-80c5-91ec8a204246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973be82c-9862-44ad-80c5-91ec8a204246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcb12c9-62b1-4ba8-aa4f-278de167d0af', 'volume_name': 'volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fb13fd-0347-4799-84c6-ab7d9ea0742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fb13fd-0347-4799-84c6-ab7d9ea0742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72b6d29-bd2a-4503-bcb0-ca1d72b71c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume 6bcb12c9-62b1-4ba8-aa4f-278de167d0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af', 'volume_size': 1} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b" returned: 0 in 0.654s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1571815820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb12c9-62b1-4ba8-aa4f-278de167d0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04c13051dc4ee1940982fb1505cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:24:55Z,use_quota=True,user_id='14cefa6bf84046b68c925c224292dc8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Creating volume 6bcb12c9-62b1-4ba8-aa4f-278de167d0af {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:24:55 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6269a555-3c9e-4334-8144-6b57ef241664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001dab5b-79e9-4133-afca-22346a6be4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:55 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b (6201e8ac-1c7c-4db3-a3e1-75a68428622b): created successfully Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001dab5b-79e9-4133-afca-22346a6be4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:55 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af 1073741824 Jul 17 14:24:55 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:55 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Flow 'volume_create_manager' (2b7ed45c-242f-401e-b918-97a1ff10507e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-80f75e0e-0998-491b-a889-efa3d1ce6cb4 tempest-TestServerVolumeAttachmentScenario-889000241 None] Created volume successfully. Jul 17 14:24:56 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af 1073741824" returned: 0 in 1.117s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:24:56 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af Jul 17 14:24:56 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:24:57 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" returned: 0 in 0.605s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72b6d29-bd2a-4503-bcb0-ca1d72b71c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc099a9-2f03-4b82-a489-541ab6b9c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:24:57 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Volume volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af (6bcb12c9-62b1-4ba8-aa4f-278de167d0af): created successfully Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc099a9-2f03-4b82-a489-541ab6b9c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:24:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Flow 'volume_create_manager' (dc6da993-828c-4be5-b901-2ba99f62b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:24:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-216eb941-57f5-4190-aa5a-deb8a9afa910 tempest-TestServerVolumeAttachmentScenario-889000241 None] Created volume successfully. Jul 17 14:24:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a47dc92c-906e-460a-b7d1-47ee79d1dc86 req-ea457b79-8476-4ea7-8a63-7c4a409f9e42 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:24:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a47dc92c-906e-460a-b7d1-47ee79d1dc86 req-ea457b79-8476-4ea7-8a63-7c4a409f9e42 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:24:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a47dc92c-906e-460a-b7d1-47ee79d1dc86 req-ea457b79-8476-4ea7-8a63-7c4a409f9e42 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:24:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a47dc92c-906e-460a-b7d1-47ee79d1dc86 req-ea457b79-8476-4ea7-8a63-7c4a409f9e42 tempest-TestInstancesWithCinderVolumes-2013011046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-4db039b1-accf-441a-af7d-fad26c770e62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '969e4325-7a52-40a0-81bc-057e17adf1e6', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:24:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-a47dc92c-906e-460a-b7d1-47ee79d1dc86 req-ea457b79-8476-4ea7-8a63-7c4a409f9e42 tempest-TestInstancesWithCinderVolumes-2013011046 None] attachment_update completed successfully. Jul 17 14:25:08 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:25:08 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=19,cinder:SELECT=19,cinder:INSERT=5,cinder:DELETE=4 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:25:10 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:25:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Flow 'volume_create_manager' (5d024d0b-89a3-42d0-9b2c-84f4eec68441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:25:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66843bec-cd4b-482a-be37-dcc2b6fb0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66843bec-cd4b-482a-be37-dcc2b6fb0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1851369716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d007967-643a-47d4-acb1-bdb832dbdd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fca596fcd9d482c8e62a5913d6eef92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:25:11Z,use_quota=True,user_id='748a3e97770e497f8c9585707b81c512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f7b323-ea27-4bc9-9999-4ed6d7cda99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f7b323-ea27-4bc9-9999-4ed6d7cda99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f2bf5-3638-4cdd-89df-4a29d1800add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f2bf5-3638-4cdd-89df-4a29d1800add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d007967-643a-47d4-acb1-bdb832dbdd2b', 'volume_name': 'volume-8d007967-643a-47d4-acb1-bdb832dbdd2b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd32a392-9c04-4afb-b2c4-0e9732e8755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd32a392-9c04-4afb-b2c4-0e9732e8755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d609d33-b3c1-4a99-94ba-6a786665974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Volume 8d007967-643a-47d4-acb1-bdb832dbdd2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d007967-643a-47d4-acb1-bdb832dbdd2b', 'volume_size': 1} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1851369716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d007967-643a-47d4-acb1-bdb832dbdd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fca596fcd9d482c8e62a5913d6eef92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:25:11Z,use_quota=True,user_id='748a3e97770e497f8c9585707b81c512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Creating volume 8d007967-643a-47d4-acb1-bdb832dbdd2b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:25:11 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:25:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:25:11 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b 1073741824 Jul 17 14:25:11 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:25:12 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 17 14:25:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b 1073741824" returned: 0 in 1.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:25:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:25:12 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b Jul 17 14:25:12 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:25:13 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b" returned: 0 in 0.608s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d609d33-b3c1-4a99-94ba-6a786665974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d007967-643a-47d4-acb1-bdb832dbdd2b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e7d883-f98a-4eac-b19f-f4982a02bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Volume volume-8d007967-643a-47d4-acb1-bdb832dbdd2b (8d007967-643a-47d4-acb1-bdb832dbdd2b): created successfully Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e7d883-f98a-4eac-b19f-f4982a02bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Flow 'volume_create_manager' (5d024d0b-89a3-42d0-9b2c-84f4eec68441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:25:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c2a9568a-316d-4821-bd35-f105c33b5056 tempest-TestMinimumBasicScenario-1208335525 None] Created volume successfully. Jul 17 14:25:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-1fc6095a-7e62-4061-9768-ed864f626f3d req-d2e7c0ad-122b-456e-8e6d-9a32d100aea7 tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-1fc6095a-7e62-4061-9768-ed864f626f3d req-d2e7c0ad-122b-456e-8e6d-9a32d100aea7 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-1fc6095a-7e62-4061-9768-ed864f626f3d req-d2e7c0ad-122b-456e-8e6d-9a32d100aea7 tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-1fc6095a-7e62-4061-9768-ed864f626f3d req-d2e7c0ad-122b-456e-8e6d-9a32d100aea7 tempest-TestMinimumBasicScenario-1208335525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-8d007967-643a-47d4-acb1-bdb832dbdd2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8041cb2d-c419-49d0-931a-d4d08a7691df', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (5c6583ad-55e6-426f-a3ac-95f98d9c8e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d5b37-1930-4b14-9f15-9e81ea48b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-1fc6095a-7e62-4061-9768-ed864f626f3d req-d2e7c0ad-122b-456e-8e6d-9a32d100aea7 tempest-TestMinimumBasicScenario-1208335525 None] attachment_update completed successfully. Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d5b37-1930-4b14-9f15-9e81ea48b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550319906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d00a8c-1c65-4187-8d1f-1fe404007d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:25:19Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78712476-ee6f-4bd3-8ae7-d48197f7bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78712476-ee6f-4bd3-8ae7-d48197f7bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caac4aa-ffef-45de-a121-9d712c8aefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4caac4aa-ffef-45de-a121-9d712c8aefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d00a8c-1c65-4187-8d1f-1fe404007d29', 'volume_name': 'volume-35d00a8c-1c65-4187-8d1f-1fe404007d29', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a461a-98d6-41dc-b5f0-daba0178a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a461a-98d6-41dc-b5f0-daba0178a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1610f1-a617-49ca-9a85-444dc84ebf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:19 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Volume 35d00a8c-1c65-4187-8d1f-1fe404007d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d00a8c-1c65-4187-8d1f-1fe404007d29', 'volume_size': 1} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550319906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d00a8c-1c65-4187-8d1f-1fe404007d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:25:19Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Creating volume 35d00a8c-1c65-4187-8d1f-1fe404007d29 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:25:19 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:25:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:25:19 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 1073741824 Jul 17 14:25:19 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:25:21 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 1073741824" returned: 0 in 1.819s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:25:21 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 Jul 17 14:25:21 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:25:21 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29" returned: 0 in 0.591s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] <== create_volume: return (2569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.589s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1610f1-a617-49ca-9a85-444dc84ebf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d00a8c-1c65-4187-8d1f-1fe404007d29', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3517eba3-4be7-47a8-aa12-347d3ecdf574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:25:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Volume volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 (35d00a8c-1c65-4187-8d1f-1fe404007d29): created successfully Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3517eba3-4be7-47a8-aa12-347d3ecdf574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:25:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (5c6583ad-55e6-426f-a3ac-95f98d9c8e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:25:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-db19d9b6-1eed-4a10-8b2b-b0db122b4f42 tempest-AttachVolumeNegativeTest-1859519371 None] Created volume successfully. Jul 17 14:25:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-6db7ad90-6837-4792-b5dd-8385027adf3d req-839787d7-a714-4c43-ad8a-5029027422e7 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-6db7ad90-6837-4792-b5dd-8385027adf3d req-839787d7-a714-4c43-ad8a-5029027422e7 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-6db7ad90-6837-4792-b5dd-8385027adf3d req-839787d7-a714-4c43-ad8a-5029027422e7 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-6db7ad90-6837-4792-b5dd-8385027adf3d req-839787d7-a714-4c43-ad8a-5029027422e7 tempest-AttachVolumeNegativeTest-1859519371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-35d00a8c-1c65-4187-8d1f-1fe404007d29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ff30dfe-163a-4dfe-a3e9-6de51574e92e', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-6db7ad90-6837-4792-b5dd-8385027adf3d req-839787d7-a714-4c43-ad8a-5029027422e7 tempest-AttachVolumeNegativeTest-1859519371 None] attachment_update completed successfully. Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:25:25 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:25:25 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:25:26 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 17 14:25:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.502s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:25:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:25:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:25:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:25:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:25:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-08c2819d-6ec3-41f9-af31-7beef1b0bd29 req-30962dbb-ebea-4d86-915d-86c8152c0f90 tempest-AttachVolumeNegativeTest-1859519371 None] Terminate volume connection completed successfully. Jul 17 14:25:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-08c2819d-6ec3-41f9-af31-7beef1b0bd29 req-30962dbb-ebea-4d86-915d-86c8152c0f90 tempest-AttachVolumeNegativeTest-1859519371 None] Deleting attachment 7ff30dfe-163a-4dfe-a3e9-6de51574e92e. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:25:38 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=7,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:25:38 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:25:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-557cd3eb-aa36-48ce-98f3-6880d4d29606 req-dd6c6d24-79ae-49cd-bec4-5bdb5037733e tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-557cd3eb-aa36-48ce-98f3-6880d4d29606 req-dd6c6d24-79ae-49cd-bec4-5bdb5037733e tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-557cd3eb-aa36-48ce-98f3-6880d4d29606 req-dd6c6d24-79ae-49cd-bec4-5bdb5037733e tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-557cd3eb-aa36-48ce-98f3-6880d4d29606 req-dd6c6d24-79ae-49cd-bec4-5bdb5037733e tempest-TestInstancesWithCinderVolumes-2013011046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac45e8cd-b0b0-478d-8d28-b922617148b8', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-557cd3eb-aa36-48ce-98f3-6880d4d29606 req-dd6c6d24-79ae-49cd-bec4-5bdb5037733e tempest-TestInstancesWithCinderVolumes-2013011046 None] attachment_update completed successfully. Jul 17 14:25:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e8d85220-2859-45ad-804e-73ec63a026ab req-b0bf6795-3f3e-4758-a437-07392e0579ae tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e8d85220-2859-45ad-804e-73ec63a026ab req-b0bf6795-3f3e-4758-a437-07392e0579ae tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-e8d85220-2859-45ad-804e-73ec63a026ab req-b0bf6795-3f3e-4758-a437-07392e0579ae tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-e8d85220-2859-45ad-804e-73ec63a026ab req-b0bf6795-3f3e-4758-a437-07392e0579ae tempest-TestServerVolumeAttachmentScenario-889000241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2f76470-bdd9-46af-ab53-671b331121a5', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-e8d85220-2859-45ad-804e-73ec63a026ab req-b0bf6795-3f3e-4758-a437-07392e0579ae tempest-TestServerVolumeAttachmentScenario-889000241 None] attachment_update completed successfully. Jul 17 14:25:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-235ff7bc-166b-4ae7-879a-8227d3c2c660 req-6152c553-e24b-4f6c-bd53-2f41c60ddc20 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-235ff7bc-166b-4ae7-879a-8227d3c2c660 req-6152c553-e24b-4f6c-bd53-2f41c60ddc20 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-235ff7bc-166b-4ae7-879a-8227d3c2c660 req-6152c553-e24b-4f6c-bd53-2f41c60ddc20 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-235ff7bc-166b-4ae7-879a-8227d3c2c660 req-6152c553-e24b-4f6c-bd53-2f41c60ddc20 tempest-TestInstancesWithCinderVolumes-2013011046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae95187b-ba6d-4090-8404-9d7900bd621e', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-235ff7bc-166b-4ae7-879a-8227d3c2c660 req-6152c553-e24b-4f6c-bd53-2f41c60ddc20 tempest-TestInstancesWithCinderVolumes-2013011046 None] attachment_update completed successfully. Jul 17 14:25:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-3d3aa977-0376-4f40-b49e-cc1ab34151ea req-6c333c3b-3959-4dcc-8aa6-44c2dc10ad87 tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:25:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-3d3aa977-0376-4f40-b49e-cc1ab34151ea req-6c333c3b-3959-4dcc-8aa6-44c2dc10ad87 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:25:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-3d3aa977-0376-4f40-b49e-cc1ab34151ea req-6c333c3b-3959-4dcc-8aa6-44c2dc10ad87 tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:25:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-3d3aa977-0376-4f40-b49e-cc1ab34151ea req-6c333c3b-3959-4dcc-8aa6-44c2dc10ad87 tempest-TestServerVolumeAttachmentScenario-889000241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bad4e7b-2d62-4767-a6e7-0256234ff7f6', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:25:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-3d3aa977-0376-4f40-b49e-cc1ab34151ea req-6c333c3b-3959-4dcc-8aa6-44c2dc10ad87 tempest-TestServerVolumeAttachmentScenario-889000241 None] attachment_update completed successfully. Jul 17 14:26:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-f280bf66-2e0b-46a0-afa6-9fd501ac8f54 req-53c82150-113a-4f44-9dec-c50b85cf61de tempest-TestServerVolumeAttachmentScenario-889000241 None] Terminate volume connection completed successfully. Jul 17 14:26:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-f280bf66-2e0b-46a0-afa6-9fd501ac8f54 req-53c82150-113a-4f44-9dec-c50b85cf61de tempest-TestServerVolumeAttachmentScenario-889000241 None] Deleting attachment 6bad4e7b-2d62-4767-a6e7-0256234ff7f6. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-bf53e10f-841c-449d-8069-c16d68952e93 req-b29ac29a-5622-41e6-bf86-e638721e96fb tempest-TestInstancesWithCinderVolumes-2013011046 None] Terminate volume connection completed successfully. Jul 17 14:26:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-bf53e10f-841c-449d-8069-c16d68952e93 req-b29ac29a-5622-41e6-bf86-e638721e96fb tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleting attachment ac45e8cd-b0b0-478d-8d28-b922617148b8. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-e9aaab54-6888-4a7f-9c24-f770d6ae6b02-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-e9aaab54-6888-4a7f-9c24-f770d6ae6b02-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-quobyte-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a58f9-2888-462b-9a36-98dd78177b2d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:02 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 Jul 17 14:26:02 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-5b3a479b-45aa-48c8-b5f3-d798ac4d79ef req-2abc7a31-2d88-4427-8293-0847d8b74b58 tempest-TestServerVolumeAttachmentScenario-889000241 None] Terminate volume connection completed successfully. Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-5b3a479b-45aa-48c8-b5f3-d798ac4d79ef req-2abc7a31-2d88-4427-8293-0847d8b74b58 tempest-TestServerVolumeAttachmentScenario-889000241 None] Deleting attachment d2f76470-bdd9-46af-ab53-671b331121a5. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:02 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" returned: 0 in 0.462s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:02 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02 Jul 17 14:26:02 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:03 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" returned: 0 in 0.381s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-e9aaab54-6888-4a7f-9c24-f770d6ae6b02" released by "delete_volume" :: held 0.916s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:03 devstack cinder-volume[87804]: WARNING cinder.quota [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-933285344-594731802 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-933285344-594731802, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:03 devstack cinder-volume[87804]: WARNING cinder.quota [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-933285344-594731802 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-933285344-594731802, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Created reservations ['22f51fb5-3268-42e7-aeca-f9251552e208', '7c8ae21b-e919-4ab5-9084-ffb87148812d', 'a4b8890d-e5e8-4791-a043-f8866ce9641d', 'db235513-6626-42ae-9fde-2fa3a807a71f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:03 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:03 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:03 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleted volume successfully. Jul 17 14:26:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-51aed9a7-e75f-492b-b9b9-09919add68e6 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-e9aaab54-6888-4a7f-9c24-f770d6ae6b02-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-df0461a0-7053-4e0e-a9d0-f76b4a1efe6e req-25333d79-f1bd-45be-b749-96279014e329 tempest-TestInstancesWithCinderVolumes-2013011046 None] Terminate volume connection completed successfully. Jul 17 14:26:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-df0461a0-7053-4e0e-a9d0-f76b4a1efe6e req-25333d79-f1bd-45be-b749-96279014e329 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleting attachment ae95187b-ba6d-4090-8404-9d7900bd621e. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-aa4cbd6d-52e3-48fc-83fe-c05031db757d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-aa4cbd6d-52e3-48fc-83fe-c05031db757d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "cinder-6bcb12c9-62b1-4ba8-aa4f-278de167d0af-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-6bcb12c9-62b1-4ba8-aa4f-278de167d0af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-quobyte-aa4cbd6d-52e3-48fc-83fe-c05031db757d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "cinder-quobyte-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-aa4cbd6d-52e3-48fc-83fe-c05031db757d" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-quobyte-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccdb414-e18b-4b56-9c97-a4f760db083d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbee57f-cd5f-4687-b05a-0079ffbe7e0d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:08 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d Jul 17 14:26:08 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:08 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af Jul 17 14:26:08 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:09 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:09 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" returned: 0 in 0.399s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d" returned: 0 in 0.429s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:09 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af Jul 17 14:26:09 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:09 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d Jul 17 14:26:09 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:09 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" returned: 0 in 0.273s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-quobyte-6bcb12c9-62b1-4ba8-aa4f-278de167d0af" released by "delete_volume" :: held 0.734s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:09 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-aa4cbd6d-52e3-48fc-83fe-c05031db757d" returned: 0 in 0.294s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-aa4cbd6d-52e3-48fc-83fe-c05031db757d" released by "delete_volume" :: held 0.793s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:09 devstack cinder-volume[87804]: WARNING cinder.quota [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-137397023-1333154645 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-137397023-1333154645, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:09 devstack cinder-volume[87804]: WARNING cinder.quota [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-137397023-1333154645 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-137397023-1333154645, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Created reservations ['26ccac17-aacc-4d49-b998-d05a125bb2e3', '8e1b981b-11e5-490d-806a-25a3a48a3807', 'f88bce7c-b1c1-491f-b8f8-7c389b20622e', '55c38146-3a57-4b43-8b5c-294a969d3949'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Created reservations ['0ee884ec-b781-48db-82c5-1fbe39805f89', '1cb638b0-3a41-4297-8592-0c02b498fd82', 'e4c62830-6cc2-4cd2-9752-1c4c68d035a0', '821112c4-ccb8-48a6-9cb8-45f260efa854'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:09 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:09 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:09 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:09 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "cinder-6201e8ac-1c7c-4db3-a3e1-75a68428622b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-6201e8ac-1c7c-4db3-a3e1-75a68428622b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "cinder-quobyte-6201e8ac-1c7c-4db3-a3e1-75a68428622b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-quobyte-6201e8ac-1c7c-4db3-a3e1-75a68428622b" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[299d803d-4344-46ad-8985-ff2d884d3f35]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:10 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:10 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.616s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.509s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Deleted volume successfully. Jul 17 14:26:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleted volume successfully. Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-757af8d7-a5dd-45bb-9347-ecba82b18f4f tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-6bcb12c9-62b1-4ba8-aa4f-278de167d0af-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-fdd80a32-9a19-4789-8935-00e778d60704 tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-aa4cbd6d-52e3-48fc-83fe-c05031db757d-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:10 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b Jul 17 14:26:10 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (08350237-3476-437e-8578-754ae72e786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0895b067-fed1-4573-afce-1dd2d7aca2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0895b067-fed1-4573-afce-1dd2d7aca2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1188964648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56806a01-72b3-4a51-9d7a-91aef21f04a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:26:11Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4efdd-622e-4ce7-9b4f-a1019f8ee953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:10 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4efdd-622e-4ce7-9b4f-a1019f8ee953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33265187-05f0-4475-af6e-06c4f008aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33265187-05f0-4475-af6e-06c4f008aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56806a01-72b3-4a51-9d7a-91aef21f04a9', 'volume_name': 'volume-56806a01-72b3-4a51-9d7a-91aef21f04a9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec033d1e-7176-4dac-bba9-0917f73f9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec033d1e-7176-4dac-bba9-0917f73f9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ead79c-5821-423c-96db-6d1bb00f9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:10 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Volume 56806a01-72b3-4a51-9d7a-91aef21f04a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56806a01-72b3-4a51-9d7a-91aef21f04a9', 'volume_size': 1} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1188964648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56806a01-72b3-4a51-9d7a-91aef21f04a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0427cee445f941fa86c5ddba28fa158b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:26:11Z,use_quota=True,user_id='a601ca7de11c4ca887839083a23226e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Creating volume 56806a01-72b3-4a51-9d7a-91aef21f04a9 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:26:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b" returned: 0 in 0.794s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:11 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 1073741824 Jul 17 14:26:11 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:11 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b Jul 17 14:26:11 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:11 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6201e8ac-1c7c-4db3-a3e1-75a68428622b" returned: 0 in 0.368s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-quobyte-6201e8ac-1c7c-4db3-a3e1-75a68428622b" released by "delete_volume" :: held 1.257s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Created reservations ['f3f12ee5-1d11-4371-8b17-a8e4f5dae407', '8ca9f2e9-42f4-4b4d-a88f-a2909c528adc', 'ccde4c4a-3a43-4335-ae5b-558d77b3a5d2', '207bf075-5706-4bd1-8d8c-c17607b1f786'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:11 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 1073741824" returned: 0 in 0.599s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:11 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:11 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:11 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 Jul 17 14:26:11 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:11 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.339s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Deleted volume successfully. Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32e01257-27c9-462e-9b80-9a3adf24695b tempest-TestServerVolumeAttachmentScenario-889000241 None] Lock "cinder-6201e8ac-1c7c-4db3-a3e1-75a68428622b-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:11 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ead79c-5821-423c-96db-6d1bb00f9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56806a01-72b3-4a51-9d7a-91aef21f04a9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff306bc0-29a8-4179-b392-774809d32515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Volume volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 (56806a01-72b3-4a51-9d7a-91aef21f04a9): created successfully Jul 17 14:26:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff306bc0-29a8-4179-b392-774809d32515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Flow 'volume_create_manager' (08350237-3476-437e-8578-754ae72e786d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:26:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ee1a1f39-0492-4264-8d23-8aa61bb03aff tempest-AttachVolumeNegativeTest-1859519371 None] Created volume successfully. Jul 17 14:26:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-9ce83cef-62ff-4655-8f48-43671e319105 req-d762bf3f-fe8d-454d-acb6-993e7751eb6e tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-9ce83cef-62ff-4655-8f48-43671e319105 req-d762bf3f-fe8d-454d-acb6-993e7751eb6e tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-9ce83cef-62ff-4655-8f48-43671e319105 req-d762bf3f-fe8d-454d-acb6-993e7751eb6e tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-9ce83cef-62ff-4655-8f48-43671e319105 req-d762bf3f-fe8d-454d-acb6-993e7751eb6e tempest-AttachVolumeNegativeTest-1859519371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-56806a01-72b3-4a51-9d7a-91aef21f04a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9fddc1f-88c8-4d05-a156-e199ae0c9ae7', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:26:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-9ce83cef-62ff-4655-8f48-43671e319105 req-d762bf3f-fe8d-454d-acb6-993e7751eb6e tempest-AttachVolumeNegativeTest-1859519371 None] attachment_update completed successfully. Jul 17 14:26:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-03b3f4a0-f3ad-4a37-8833-11d0ec39bf83 req-c162940c-7a02-46e2-991c-1266125e2a6e tempest-TestInstancesWithCinderVolumes-2013011046 None] Terminate volume connection completed successfully. Jul 17 14:26:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-03b3f4a0-f3ad-4a37-8833-11d0ec39bf83 req-c162940c-7a02-46e2-991c-1266125e2a6e tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleting attachment 969e4325-7a52-40a0-81bc-057e17adf1e6. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-4db039b1-accf-441a-af7d-fad26c770e62-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-4db039b1-accf-441a-af7d-fad26c770e62-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "cinder-quobyte-4db039b1-accf-441a-af7d-fad26c770e62" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-4db039b1-accf-441a-af7d-fad26c770e62" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e7c1b2-ceca-43a2-ab53-dd851d3dab0f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:16 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 Jul 17 14:26:16 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:16 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62" returned: 0 in 0.598s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:16 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62 Jul 17 14:26:16 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:17 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4db039b1-accf-441a-af7d-fad26c770e62" returned: 0 in 0.538s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-e12ee8f3-598f-472c-92c8-6a02756ea31f req-f95b1f4e-10c9-45c7-abfb-502f13d6d417 tempest-AttachVolumeNegativeTest-1859519371 None] Terminate volume connection completed successfully. Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-e12ee8f3-598f-472c-92c8-6a02756ea31f req-f95b1f4e-10c9-45c7-abfb-502f13d6d417 tempest-AttachVolumeNegativeTest-1859519371 None] Deleting attachment c9fddc1f-88c8-4d05-a156-e199ae0c9ae7. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-quobyte-4db039b1-accf-441a-af7d-fad26c770e62" released by "delete_volume" :: held 1.213s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:17 devstack cinder-volume[87804]: WARNING cinder.quota [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1697161863-1560581014 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1697161863-1560581014, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:17 devstack cinder-volume[87804]: WARNING cinder.quota [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1697161863-1560581014 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1697161863-1560581014, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Created reservations ['2d9fbf5b-72bf-4d90-8b31-4ab59d46c497', 'f39009e5-89ba-4100-ad53-ec1adbb07bcb', '98e7bbec-96e8-4f63-9f6c-76ef66394ea7', '47f7d96b-c13e-4fe1-a155-9a0c2157b328'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:17 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:17 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:17 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Deleted volume successfully. Jul 17 14:26:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5b4ff2b-103c-4f4d-aa1a-e3fafc2cd51f tempest-TestInstancesWithCinderVolumes-2013011046 None] Lock "cinder-4db039b1-accf-441a-af7d-fad26c770e62-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-56806a01-72b3-4a51-9d7a-91aef21f04a9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-56806a01-72b3-4a51-9d7a-91aef21f04a9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-quobyte-56806a01-72b3-4a51-9d7a-91aef21f04a9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-56806a01-72b3-4a51-9d7a-91aef21f04a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaf09f7-a811-436c-9d1d-84c6feeebb13]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:25 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 Jul 17 14:26:25 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:25 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:25 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:25 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9" returned: 0 in 0.578s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:25 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9 Jul 17 14:26:25 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:26 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:26:26 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-56806a01-72b3-4a51-9d7a-91aef21f04a9" returned: 0 in 0.334s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-56806a01-72b3-4a51-9d7a-91aef21f04a9" released by "delete_volume" :: held 0.977s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Created reservations ['37871f69-13e3-463e-a0e7-e09c371c5c39', '8e61d261-3599-43b1-b7c9-cd0b860ae369', '28c80ead-9870-4be2-aea4-6dfe3402363a', '015e6a84-2a20-49e1-9d2c-e07879b0d171'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:26 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:26 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:26 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Deleted volume successfully. Jul 17 14:26:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-648d5418-d3d6-4cc5-a688-95c50edd8f37 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-56806a01-72b3-4a51-9d7a-91aef21f04a9-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-35d00a8c-1c65-4187-8d1f-1fe404007d29-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-35d00a8c-1c65-4187-8d1f-1fe404007d29-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-quobyte-35d00a8c-1c65-4187-8d1f-1fe404007d29" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-35d00a8c-1c65-4187-8d1f-1fe404007d29" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de5341-98b6-43c5-8355-d86efa81139c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:27 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 Jul 17 14:26:27 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:28 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29" returned: 0 in 0.519s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:28 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29 Jul 17 14:26:28 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:28 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35d00a8c-1c65-4187-8d1f-1fe404007d29" returned: 0 in 0.290s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-35d00a8c-1c65-4187-8d1f-1fe404007d29" released by "delete_volume" :: held 0.862s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Created reservations ['8bd6a05a-a288-4edb-a0fa-68465b2b3281', '5b3b7f83-ead6-4a0d-9bfe-468210762c87', '696d72bf-dfd4-41bb-bb59-ddcedcdd0cb7', 'aec75118-be13-4bf9-8075-a547f16772f2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:28 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:28 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-e362b25c-9cdf-478e-8cbe-07d0d87cedc3-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:29 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.358s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-e362b25c-9cdf-478e-8cbe-07d0d87cedc3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Deleted volume successfully. Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "cinder-quobyte-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-585de797-4bcb-449d-a2b4-52c254c87f01 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-35d00a8c-1c65-4187-8d1f-1fe404007d29-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee651aa-50e9-43ca-b5e3-264820df0701]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:29 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 Jul 17 14:26:29 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:29 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" returned: 0 in 0.504s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:29 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3 Jul 17 14:26:29 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:30 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" returned: 0 in 0.337s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-quobyte-e362b25c-9cdf-478e-8cbe-07d0d87cedc3" released by "delete_volume" :: held 0.891s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Created reservations ['c315182e-d627-49a9-8e82-4f51cd3409fc', 'eabc1137-d066-418d-a17e-c6a69f1f2456', 'bfc57cdd-0193-44be-bb4c-f59a0912b962', '6b7d0647-eb0a-4aa9-a540-29ef9ac70fea'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:30 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:30 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:30 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.389s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Deleted volume successfully. Jul 17 14:26:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3911fc91-1706-40c0-8b7e-1585ea36d875 tempest-AttachVolumeNegativeTest-1859519371 None] Lock "cinder-e362b25c-9cdf-478e-8cbe-07d0d87cedc3-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-a2ebe792-0c2a-473b-a82e-62e25189e852 req-c98b117b-b997-45c7-8369-712a28b752ea tempest-TestMinimumBasicScenario-1208335525 None] Terminate volume connection completed successfully. Jul 17 14:26:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a2ebe792-0c2a-473b-a82e-62e25189e852 req-c98b117b-b997-45c7-8369-712a28b752ea tempest-TestMinimumBasicScenario-1208335525 None] Deleting attachment 8041cb2d-c419-49d0-931a-d4d08a7691df. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "cinder-8d007967-643a-47d4-acb1-bdb832dbdd2b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "cinder-8d007967-643a-47d4-acb1-bdb832dbdd2b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "cinder-quobyte-8d007967-643a-47d4-acb1-bdb832dbdd2b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "cinder-quobyte-8d007967-643a-47d4-acb1-bdb832dbdd2b" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac55cfc4-065f-4da4-96f7-cc9aea2dc74d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:39 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b Jul 17 14:26:39 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:39 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b" returned: 0 in 0.621s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:39 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b Jul 17 14:26:39 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:39 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8d007967-643a-47d4-acb1-bdb832dbdd2b" returned: 0 in 0.450s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "cinder-quobyte-8d007967-643a-47d4-acb1-bdb832dbdd2b" released by "delete_volume" :: held 1.142s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Created reservations ['17262a1e-8a4c-4c74-ad03-d9785e413ea1', 'b2a7c8d8-f9dd-4390-b955-33ae7f90d219', 'b6d568c0-b0cf-4a4c-ad43-9f404db1584b', '9a38be8f-e588-4b3c-b62f-af7fa1f984bc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:40 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:40 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:40 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:40 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Deleted volume successfully. Jul 17 14:26:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6e74bca1-18b9-44b2-82f1-f6e5710813ed tempest-TestMinimumBasicScenario-1208335525 None] Lock "cinder-8d007967-643a-47d4-acb1-bdb832dbdd2b-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Flow 'volume_create_manager' (2ee3cf68-7b7f-4648-920c-990861b82827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92874b3a-896f-40df-9c52-96460c0dd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92874b3a-896f-40df-9c52-96460c0dd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-979056058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb197d3-2e3b-4e34-ab84-a06631677a27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acb01c77b162478db93f7b42ad304b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:26:43Z,use_quota=True,user_id='1717539da25b46f38709961f14a9a969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fd55be-0462-463d-8beb-d28fd9e4b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fd55be-0462-463d-8beb-d28fd9e4b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a02d47-a674-44bc-92a7-018e3a508b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a02d47-a674-44bc-92a7-018e3a508b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb197d3-2e3b-4e34-ab84-a06631677a27', 'volume_name': 'volume-1fb197d3-2e3b-4e34-ab84-a06631677a27', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db2aa3d-785f-47d7-bda0-31177b262168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db2aa3d-785f-47d7-bda0-31177b262168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4820ffc5-47b3-42b3-9937-0f58520c0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Volume 1fb197d3-2e3b-4e34-ab84-a06631677a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb197d3-2e3b-4e34-ab84-a06631677a27', 'volume_size': 1} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-979056058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb197d3-2e3b-4e34-ab84-a06631677a27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acb01c77b162478db93f7b42ad304b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:26:43Z,use_quota=True,user_id='1717539da25b46f38709961f14a9a969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Creating volume 1fb197d3-2e3b-4e34-ab84-a06631677a27 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:26:43 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:26:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:43 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 1073741824 Jul 17 14:26:43 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:44 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 1073741824" returned: 0 in 0.718s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:44 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 Jul 17 14:26:44 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:44 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27" returned: 0 in 0.419s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4820ffc5-47b3-42b3-9937-0f58520c0932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb197d3-2e3b-4e34-ab84-a06631677a27', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca32545-a083-4869-a85d-a4139321f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:26:44 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Volume volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 (1fb197d3-2e3b-4e34-ab84-a06631677a27): created successfully Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca32545-a083-4869-a85d-a4139321f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:26:44 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Flow 'volume_create_manager' (2ee3cf68-7b7f-4648-920c-990861b82827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:26:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-05b61102-9083-46a5-8165-d7a0d6804e31 req-dfae1c7b-d705-413d-8059-7983c74d6750 tempest-VolumesGetTestJSON-1371374641 None] Created volume successfully. Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Acquiring lock "cinder-1fb197d3-2e3b-4e34-ab84-a06631677a27-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "cinder-1fb197d3-2e3b-4e34-ab84-a06631677a27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Acquiring lock "cinder-quobyte-1fb197d3-2e3b-4e34-ab84-a06631677a27" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "cinder-quobyte-1fb197d3-2e3b-4e34-ab84-a06631677a27" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6727069-cb70-485c-a7fa-d2f44db555da]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:46 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 Jul 17 14:26:46 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:46 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27" returned: 0 in 0.546s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:46 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27 Jul 17 14:26:46 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:47 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1fb197d3-2e3b-4e34-ab84-a06631677a27" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "cinder-quobyte-1fb197d3-2e3b-4e34-ab84-a06631677a27" released by "delete_volume" :: held 0.949s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.quota [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Created reservations ['efec42fe-2ac9-4b1c-8e30-a402a58e3c45', '8dda0c0e-3dcc-4140-a1fd-5716e13794f1', '1a9ab654-6a86-4a04-8955-919db9b52657', '461feca6-5c82-4b01-8c8f-e65c0099427e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:26:47 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:26:47 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:26:47 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.272s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.manager [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:26:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Deleted volume successfully. Jul 17 14:26:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-a39d982a-31bd-4159-996b-bfa53080860d req-7da1f6e0-4106-4ef6-81d1-81d3743c03bf tempest-VolumesGetTestJSON-1371374641 None] Lock "cinder-1fb197d3-2e3b-4e34-ab84-a06631677a27-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:26:57 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=92,cinder:UPDATE=107,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:26:57 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=95,cinder:UPDATE=80,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:26:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9b2391b7-ed2f-44b4-be35-fe170ffe2224 tempest-BackendsCapabilitiesAdminTestsJSON-530089143 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6747207641602, 'free_capacity_gb': 1775.6747207641602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87804) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 14:26:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b0d12334-4e1a-45c2-a1fb-3b15912b3da4 tempest-BackendsCapabilitiesAdminTestsJSON-530089143 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6747207641602, 'free_capacity_gb': 1775.6747207641602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87804) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Flow 'volume_create_manager' (b98f8ceb-2ecd-4a04-b88a-fd4283928d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef14a10-765a-4cc3-9f27-c8dfdc719ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef14a10-765a-4cc3-9f27-c8dfdc719ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1928995615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a0fed2-779e-476f-ab83-907e8bbe828a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12444b4a446740a7b900d14d3e156340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:15Z,use_quota=True,user_id='3e47b53274e7443bb81d385026f7bc16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4d3fe1e-f9d1-4e7a-aafb-739aab211196),volume_type_id=f4d3fe1e-f9d1-4e7a-aafb-739aab211196)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e403b78-9a1d-4fc3-9374-f75c0f690598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e403b78-9a1d-4fc3-9374-f75c0f690598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517955e8-391b-4e4b-b51f-1fbe1d400714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517955e8-391b-4e4b-b51f-1fbe1d400714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a0fed2-779e-476f-ab83-907e8bbe828a', 'volume_name': 'volume-25a0fed2-779e-476f-ab83-907e8bbe828a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405358d4-d6af-4a72-94e8-8b04f441ca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405358d4-d6af-4a72-94e8-8b04f441ca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8444b400-ddbd-4a94-96fb-b9652c53fe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Volume 25a0fed2-779e-476f-ab83-907e8bbe828a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a0fed2-779e-476f-ab83-907e8bbe828a', 'volume_size': 1} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1928995615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a0fed2-779e-476f-ab83-907e8bbe828a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12444b4a446740a7b900d14d3e156340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:15Z,use_quota=True,user_id='3e47b53274e7443bb81d385026f7bc16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4d3fe1e-f9d1-4e7a-aafb-739aab211196),volume_type_id=f4d3fe1e-f9d1-4e7a-aafb-739aab211196)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Creating volume 25a0fed2-779e-476f-ab83-907e8bbe828a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:15 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:15 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a 1073741824 Jul 17 14:27:15 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Flow 'volume_create_manager' (d582d148-4be8-4c86-8388-5dab2b5690f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169aa9ef-19f3-4ada-b787-8d4f8132bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169aa9ef-19f3-4ada-b787-8d4f8132bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774176742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a195cef1-1bac-42b0-9382-5b17ef052cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dba085c05846ad844884577baaafaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:15Z,use_quota=True,user_id='66d49b946cbf40269a3fb453a0cac383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511e8290-bbd3-47e5-b208-f2193b2b446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511e8290-bbd3-47e5-b208-f2193b2b446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452a2c6a-0d85-445b-b6e3-3ab4f47f8e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:27:15 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a 1073741824" returned: 0 in 0.691s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:15 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a Jul 17 14:27:15 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452a2c6a-0d85-445b-b6e3-3ab4f47f8e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a195cef1-1bac-42b0-9382-5b17ef052cad', 'volume_name': 'volume-a195cef1-1bac-42b0-9382-5b17ef052cad', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61d0d3-157e-4350-a6bf-874ef7abbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61d0d3-157e-4350-a6bf-874ef7abbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f37a220-66fb-4f65-bd86-f75c3c347ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:15 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Volume a195cef1-1bac-42b0-9382-5b17ef052cad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a195cef1-1bac-42b0-9382-5b17ef052cad', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 14:27:15 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Trying to clone a195cef1-1bac-42b0-9382-5b17ef052cad from image fe33b284-d390-4ad6-9a67-4047a22fe63a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:27:16 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a" returned: 0 in 0.400s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8444b400-ddbd-4a94-96fb-b9652c53fe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a0fed2-779e-476f-ab83-907e8bbe828a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f860aa-cb5f-4f9a-ba75-a78510872f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Volume volume-25a0fed2-779e-476f-ab83-907e8bbe828a (25a0fed2-779e-476f-ab83-907e8bbe828a): created successfully Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f860aa-cb5f-4f9a-ba75-a78510872f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Flow 'volume_create_manager' (b98f8ceb-2ecd-4a04-b88a-fd4283928d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-47cc1a76-3f73-4d96-8636-48cd79d606e4 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Created volume successfully. Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:27:16 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Image download 20.69 MB at 20.69 MB/s Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d61ebb-46b7-4a53-9c1e-3a59d2fd2bd6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:16 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD Jul 17 14:27:16 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:17 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a is fetched for user 66d49b946cbf40269a3fb453a0cac383. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fd48d-3191-4884-a441-687fcb812f1d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:17 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD Jul 17 14:27:17 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:17 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:17 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:17 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD" returned: 0 in 0.562s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774176742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a195cef1-1bac-42b0-9382-5b17ef052cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dba085c05846ad844884577baaafaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:15Z,use_quota=True,user_id='66d49b946cbf40269a3fb453a0cac383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Creating volume a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:17 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:17 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1073741824 Jul 17 14:27:17 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:18 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-df3f1fef-7766-4df4-8d71-ee06b64f3c06 tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Retype volume completed successfully. Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Flow 'volume_create_manager' (42ca8069-62e4-415e-b17e-1fe8092a0960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750c50a0-ad0b-4ff6-985a-d50721ffcc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750c50a0-ad0b-4ff6-985a-d50721ffcc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-837124334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06379643-3994-4d99-994a-205ca0128747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc8a872447c4f5a9748721c8c3724e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:18Z,use_quota=True,user_id='aa96564565e643258f97a247c0d0f061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ac66f7-f0cb-4887-9b5f-2c50ee06f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ac66f7-f0cb-4887-9b5f-2c50ee06f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4582dd2e-96c2-4c96-a1b3-9bb0efdf0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4582dd2e-96c2-4c96-a1b3-9bb0efdf0635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06379643-3994-4d99-994a-205ca0128747', 'volume_name': 'volume-06379643-3994-4d99-994a-205ca0128747', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f366c4-1397-4ff9-b4ac-ea5c618fba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f366c4-1397-4ff9-b4ac-ea5c618fba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf5b24f-c77c-4e3b-a8ea-e1e7fd52141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Volume 06379643-3994-4d99-994a-205ca0128747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06379643-3994-4d99-994a-205ca0128747', 'volume_size': 1} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:18 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1073741824" returned: 0 in 0.647s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:18 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad Jul 17 14:27:18 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:18 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-837124334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06379643-3994-4d99-994a-205ca0128747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc8a872447c4f5a9748721c8c3724e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:18Z,use_quota=True,user_id='aa96564565e643258f97a247c0d0f061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Creating volume 06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:18 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:18 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 1073741824 Jul 17 14:27:18 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Attempting download of fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume a195cef1-1bac-42b0-9382-5b17ef052cad. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[70654a76-f329-4169-826b-c0e7529916eb]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "cinder-25a0fed2-779e-476f-ab83-907e8bbe828a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:19 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5 Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "cinder-25a0fed2-779e-476f-ab83-907e8bbe828a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:19 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "cinder-quobyte-25a0fed2-779e-476f-ab83-907e8bbe828a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "cinder-quobyte-25a0fed2-779e-476f-ab83-907e8bbe828a" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[17466d59-0793-4477-a931-0baec97bea19]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:19 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a Jul 17 14:27:19 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:19 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5" returned: 0 in 0.603s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:19 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5 Jul 17 14:27:19 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:19 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 1073741824" returned: 0 in 0.873s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:19 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:27:19 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:19 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a" returned: 0 in 0.544s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:19 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a Jul 17 14:27:19 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:19 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5" returned: 1 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe33b284-d390-4ad6-9a67-4047a22fe63a_ogswm2h5' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[218eecce-4494-49e6-88af-fb2cb12c8d8a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:20 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD Jul 17 14:27:20 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:20 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-25a0fed2-779e-476f-ab83-907e8bbe828a" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "cinder-quobyte-25a0fed2-779e-476f-ab83-907e8bbe828a" released by "delete_volume" :: held 0.963s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:20 devstack cinder-volume[87804]: WARNING cinder.quota [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:20 devstack cinder-volume[87804]: WARNING cinder.quota [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:20 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.526s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf5b24f-c77c-4e3b-a8ea-e1e7fd52141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06379643-3994-4d99-994a-205ca0128747', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c90e88-251e-40b3-aaf9-8ddff33dcae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Volume volume-06379643-3994-4d99-994a-205ca0128747 (06379643-3994-4d99-994a-205ca0128747): created successfully Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c90e88-251e-40b3-aaf9-8ddff33dcae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Flow 'volume_create_manager' (42ca8069-62e4-415e-b17e-1fe8092a0960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Created reservations ['68fc01a6-8831-4136-a9aa-68c835026495', '9f3e26cb-d6cf-4e75-8398-efb6dfaecf92', 'ec4d2bb1-2f67-429c-8f39-84edad693901', '103a27e9-ddde-4e0c-b62f-99fa2ff6c3d4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0d6ae76d-6e8c-4d31-939e-a3f1dcdc441c tempest-TestStampPattern-1345969760 None] Created volume successfully. Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:20 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD" returned: 0 in 0.613s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] fe33b284-d390-4ad6-9a67-4047a22fe63a was qcow2, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:20 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:20 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:20 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad Jul 17 14:27:20 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Flow 'volume_create_manager' (28557940-da4c-4d8e-a27d-6c70523cc532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ce6919-6bac-49df-b1bf-1aeb04ef746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ce6919-6bac-49df-b1bf-1aeb04ef746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9c3f7c-ec44-4bef-8e74-46efdee6b307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1944ef422f4aefb3f698a32b6c3b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:21Z,use_quota=True,user_id='4755a13e88344774bd2b8c55f00b68d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6878354c-d45c-426f-b8ab-597406ab23f2),volume_type_id=6878354c-d45c-426f-b8ab-597406ab23f2)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dddf38b-9fc3-493e-a5ff-1b2e489048e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dddf38b-9fc3-493e-a5ff-1b2e489048e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd9b131-771e-411d-99d0-b2e301f96f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:27:20 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.376s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:20 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Deleted volume successfully. Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-dbaab3f6-b610-47b2-8a42-61cf4470b5ba tempest-VolumeRetypeWithoutMigrationTest-1039243237 None] Lock "cinder-25a0fed2-779e-476f-ab83-907e8bbe828a-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd9b131-771e-411d-99d0-b2e301f96f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c9c3f7c-ec44-4bef-8e74-46efdee6b307', 'volume_name': 'volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307', 'volume_size': 1, 'image_id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b736204160c005fff5e81d80c0cb6c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1944ef422f4aefb3f698a32b6c3b9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29dc61412972ca416c4dc1ccb9f49da20e99b3d8076bc601a7e7db019434fa94a623290397d5a97c8be52430f3df5873dd6ba847e2de2392c727c527022ca730', 'id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'created_at': datetime.datetime(2026, 7, 17, 12, 27, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 27, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08ec520c-0975-4711-bc09-4412d3a00ee6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a850df2-8a59-4896-9c0f-a3f8e08995df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a850df2-8a59-4896-9c0f-a3f8e08995df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4f0519-2e26-4b1b-8c59-51302bad0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307', 'volume_size': 1, 'image_id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b736204160c005fff5e81d80c0cb6c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1944ef422f4aefb3f698a32b6c3b9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29dc61412972ca416c4dc1ccb9f49da20e99b3d8076bc601a7e7db019434fa94a623290397d5a97c8be52430f3df5873dd6ba847e2de2392c727c527022ca730', 'id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'created_at': datetime.datetime(2026, 7, 17, 12, 27, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 27, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08ec520c-0975-4711-bc09-4412d3a00ee6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Trying to clone 7c9c3f7c-ec44-4bef-8e74-46efdee6b307 from image 08ec520c-0975-4711-bc09-4412d3a00ee6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:27:21 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Image download 0.00 MB at 0.00 MB/s Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2529890f-4a13-4e2c-a280-720fde1aa26e]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:21 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:21 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:22 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 0 in 0.681s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:22 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:22 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:22 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Temporary image 08ec520c-0975-4711-bc09-4412d3a00ee6 is fetched for user 4755a13e88344774bd2b8c55f00b68d5. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dfcd37-3a84-48e6-a7eb-c7eb4e4ea4da]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:22 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:22 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:23 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:23 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:23 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:23 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad" returned: 0 in 2.787s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe33b284-d390-4ad6-9a67-4047a22fe63a_mr0mjc77devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:27:23 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Converted 112.00 MB image at 40.17 MB/s Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:23 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1G Jul 17 14:27:23 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:23 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9c3f7c-ec44-4bef-8e74-46efdee6b307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1944ef422f4aefb3f698a32b6c3b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:21Z,use_quota=True,user_id='4755a13e88344774bd2b8c55f00b68d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6878354c-d45c-426f-b8ab-597406ab23f2),volume_type_id=6878354c-d45c-426f-b8ab-597406ab23f2)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Creating volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:23 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:23 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1073741824 Jul 17 14:27:23 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:23 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad 1G" returned: 0 in 0.437s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Downloaded image fe33b284-d390-4ad6-9a67-4047a22fe63a ((None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}])) to volume a195cef1-1bac-42b0-9382-5b17ef052cad successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Temporary image fe33b284-d390-4ad6-9a67-4047a22fe63a for user 66d49b946cbf40269a3fb453a0cac383 is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Marking volume a195cef1-1bac-42b0-9382-5b17ef052cad as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Copying metadata from image fe33b284-d390-4ad6-9a67-4047a22fe63a to a195cef1-1bac-42b0-9382-5b17ef052cad. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:27:23 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Creating volume glance metadata for volume a195cef1-1bac-42b0-9382-5b17ef052cad backed by image fe33b284-d390-4ad6-9a67-4047a22fe63a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f37a220-66fb-4f65-bd86-f75c3c347ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a195cef1-1bac-42b0-9382-5b17ef052cad', 'volume_size': 1, 'image_id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe33b284-d390-4ad6-9a67-4047a22fe63a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70355285ae004383a30793a4f74458f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe33b284-d390-4ad6-9a67-4047a22fe63a', 'created_at': datetime.datetime(2026, 7, 17, 12, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe33b284-d390-4ad6-9a67-4047a22fe63a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c614e9d4-a74b-4377-905e-57186ab4dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:24 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Volume volume-a195cef1-1bac-42b0-9382-5b17ef052cad (a195cef1-1bac-42b0-9382-5b17ef052cad): created successfully Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c614e9d4-a74b-4377-905e-57186ab4dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Flow 'volume_create_manager' (d582d148-4be8-4c86-8388-5dab2b5690f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0f0b318b-9a2c-4ddd-a041-a10ab3e71c09 tempest-TestShelveInstance-1315582905 None] Created volume successfully. Jul 17 14:27:24 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1073741824" returned: 0 in 0.586s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:24 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 Jul 17 14:27:24 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:24 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Attempting download of 08ec520c-0975-4711-bc09-4412d3a00ee6 ((None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}])) to volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0988cc8-5ea6-451a-9033-0e8af5b24c63]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:24 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23 Jul 17 14:27:24 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:25 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:25 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23 Jul 17 14:27:25 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:25 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23" returned: 1 in 0.446s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08ec520c-0975-4711-bc09-4412d3a00ee6_wv6tnl23' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:27:25 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:25 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5562f36-e308-41db-853b-f1fb7125d23a]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:25 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:25 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:26 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:27:26 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:26 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD Jul 17 14:27:26 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:27 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD" returned: 1 in 0.912s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:27:27 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] 08ec520c-0975-4711-bc09-4412d3a00ee6 was raw, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:27:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:27 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 Jul 17 14:27:27 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:28 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" returned: 0 in 1.161s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:28 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08ec520c-0975-4711-bc09-4412d3a00ee6_rug5ruk5devstack@QuobyteHD, size 0.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:27:28 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 14:27:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:28 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1G Jul 17 14:27:28 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:29 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 1G" returned: 0 in 0.707s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Downloaded image 08ec520c-0975-4711-bc09-4412d3a00ee6 ((None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}])) to volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Temporary image 08ec520c-0975-4711-bc09-4412d3a00ee6 for user 4755a13e88344774bd2b8c55f00b68d5 is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Marking volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Copying metadata from image 08ec520c-0975-4711-bc09-4412d3a00ee6 to 7c9c3f7c-ec44-4bef-8e74-46efdee6b307. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Creating volume glance metadata for volume 7c9c3f7c-ec44-4bef-8e74-46efdee6b307 backed by image 08ec520c-0975-4711-bc09-4412d3a00ee6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b736204160c005fff5e81d80c0cb6c40', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4f0519-2e26-4b1b-8c59-51302bad0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307', 'volume_size': 1, 'image_id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08ec520c-0975-4711-bc09-4412d3a00ee6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b736204160c005fff5e81d80c0cb6c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1944ef422f4aefb3f698a32b6c3b9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29dc61412972ca416c4dc1ccb9f49da20e99b3d8076bc601a7e7db019434fa94a623290397d5a97c8be52430f3df5873dd6ba847e2de2392c727c527022ca730', 'id': '08ec520c-0975-4711-bc09-4412d3a00ee6', 'created_at': datetime.datetime(2026, 7, 17, 12, 27, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 27, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08ec520c-0975-4711-bc09-4412d3a00ee6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa90c0c-851a-4cbc-bdae-678099c77c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Volume volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 (7c9c3f7c-ec44-4bef-8e74-46efdee6b307): created successfully Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa90c0c-851a-4cbc-bdae-678099c77c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Flow 'volume_create_manager' (28557940-da4c-4d8e-a27d-6c70523cc532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-121b4618-627b-487e-a70d-4a58aeee4868 tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Created volume successfully. Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Acquiring lock "cinder-7c9c3f7c-ec44-4bef-8e74-46efdee6b307-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "cinder-7c9c3f7c-ec44-4bef-8e74-46efdee6b307-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Acquiring lock "cinder-quobyte-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "cinder-quobyte-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" acquired by "delete_volume" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb53c4-4c53-4ced-8579-0ae408183d19]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2e620981-2135-4bb6-8820-4f27c747bfb7 req-90785727-1c5b-49d8-b3e3-3f53fd2ec056 tempest-TestShelveInstance-1315582905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2e620981-2135-4bb6-8820-4f27c747bfb7 req-90785727-1c5b-49d8-b3e3-3f53fd2ec056 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:30 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 Jul 17 14:27:30 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-2e620981-2135-4bb6-8820-4f27c747bfb7 req-90785727-1c5b-49d8-b3e3-3f53fd2ec056 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-2e620981-2135-4bb6-8820-4f27c747bfb7 req-90785727-1c5b-49d8-b3e3-3f53fd2ec056 tempest-TestShelveInstance-1315582905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-a195cef1-1bac-42b0-9382-5b17ef052cad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97413e93-e803-44a8-a05c-d85eabd0cc51', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:27:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-2e620981-2135-4bb6-8820-4f27c747bfb7 req-90785727-1c5b-49d8-b3e3-3f53fd2ec056 tempest-TestShelveInstance-1315582905 None] attachment_update completed successfully. Jul 17 14:27:31 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" returned: 0 in 1.065s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:31 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307 Jul 17 14:27:31 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:31 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" returned: 0 in 0.696s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "cinder-quobyte-7c9c3f7c-ec44-4bef-8e74-46efdee6b307" released by "delete_volume" :: held 1.863s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:31 devstack cinder-volume[87804]: WARNING cinder.quota [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:31 devstack cinder-volume[87804]: WARNING cinder.quota [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Created reservations ['b30feb71-5937-4187-9101-4c4aa92f7e74', 'cc4a4fbc-b659-437e-89f4-65ad053657e2', '8138f74b-d473-4cd5-95dc-3f334f760a37', '084a9d88-24da-489b-abdf-12593c9af69c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:32 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:32 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Flow 'volume_create_manager' (41db1622-5118-4429-ac2f-4e8b33343d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80970b2-7e1d-4cd1-944d-47b48ab8dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80970b2-7e1d-4cd1-944d-47b48ab8dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664742152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334c6d7-2119-4715-9760-79c0ab09dc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50e376729df647e0a48fe094e3377e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:33Z,use_quota=True,user_id='03b27532f2ba4d09b8a8ecf45506037d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03e3ebd-ee5b-45bf-ad26-87bce1ad130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03e3ebd-ee5b-45bf-ad26-87bce1ad130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0428fd3f-c67e-45cf-9a3b-6379150a6c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0428fd3f-c67e-45cf-9a3b-6379150a6c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5334c6d7-2119-4715-9760-79c0ab09dc1a', 'volume_name': 'volume-5334c6d7-2119-4715-9760-79c0ab09dc1a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596035a-617a-4442-9673-1193c78f2c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596035a-617a-4442-9673-1193c78f2c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cebef8-9aaf-4767-b158-5223c27feed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Volume 5334c6d7-2119-4715-9760-79c0ab09dc1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5334c6d7-2119-4715-9760-79c0ab09dc1a', 'volume_size': 1} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664742152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334c6d7-2119-4715-9760-79c0ab09dc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50e376729df647e0a48fe094e3377e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:33Z,use_quota=True,user_id='03b27532f2ba4d09b8a8ecf45506037d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Creating volume 5334c6d7-2119-4715-9760-79c0ab09dc1a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:32 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:32 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.630s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Deleted volume successfully. Jul 17 14:27:32 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a 1073741824 Jul 17 14:27:32 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e12145b4-29c5-4340-8340-7c5f247ccd9b tempest-VolumeAndVolumeTypeFromImageTest-1249860645 None] Lock "cinder-7c9c3f7c-ec44-4bef-8e74-46efdee6b307-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:33 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a 1073741824" returned: 0 in 0.968s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:33 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a Jul 17 14:27:33 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:34 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a" returned: 0 in 0.365s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cebef8-9aaf-4767-b158-5223c27feed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5334c6d7-2119-4715-9760-79c0ab09dc1a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6217c949-60bc-49fd-afa6-e6da52b36669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:34 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Volume volume-5334c6d7-2119-4715-9760-79c0ab09dc1a (5334c6d7-2119-4715-9760-79c0ab09dc1a): created successfully Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6217c949-60bc-49fd-afa6-e6da52b36669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Flow 'volume_create_manager' (41db1622-5118-4429-ac2f-4e8b33343d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ddbe9d69-1fef-4daa-bba8-90f518f3ace5 tempest-VolumesServicesTestJSON-750278796 None] Created volume successfully. Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Acquiring lock "cinder-5334c6d7-2119-4715-9760-79c0ab09dc1a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "cinder-5334c6d7-2119-4715-9760-79c0ab09dc1a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Acquiring lock "cinder-quobyte-5334c6d7-2119-4715-9760-79c0ab09dc1a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "cinder-quobyte-5334c6d7-2119-4715-9760-79c0ab09dc1a" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c095373-43df-4b5f-92ab-ee6f553b320c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:35 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a Jul 17 14:27:35 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:35 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a" returned: 0 in 0.692s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:36 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a Jul 17 14:27:36 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:36 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5334c6d7-2119-4715-9760-79c0ab09dc1a" returned: 0 in 0.620s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "cinder-quobyte-5334c6d7-2119-4715-9760-79c0ab09dc1a" released by "delete_volume" :: held 1.411s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Created reservations ['689565c3-bd9c-47ae-beff-e37c540a1fa8', '69428328-01c1-47dc-bbf7-1f304a6086c2', '69e03027-3196-4a6c-a642-a4e74b8b2896', '13e15da7-b011-4d98-9d31-8d2e4f7f5d82'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:37 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:37 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:37 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.722s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Deleted volume successfully. Jul 17 14:27:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-922a3fea-caa3-4447-8ed5-82234fec6f5d tempest-VolumesServicesTestJSON-750278796 None] Lock "cinder-5334c6d7-2119-4715-9760-79c0ab09dc1a-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (268ce050-0ce1-4378-9307-20705463f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263c6ec-493b-40f7-9969-81ae2ee713e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263c6ec-493b-40f7-9969-81ae2ee713e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338225591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419d20f-874b-42b0-88da-ce4d93e61311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:42Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc629ab-bcb3-461a-bf17-6caf3b8544fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc629ab-bcb3-461a-bf17-6caf3b8544fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fb1484-dc36-4133-b6c3-c59853a4c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fb1484-dc36-4133-b6c3-c59853a4c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c419d20f-874b-42b0-88da-ce4d93e61311', 'volume_name': 'volume-c419d20f-874b-42b0-88da-ce4d93e61311', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9cb23f-fbe4-4969-b5cd-6a6ff508b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9cb23f-fbe4-4969-b5cd-6a6ff508b583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d5652c-1ebd-40fb-add2-1698fd50b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:42 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume c419d20f-874b-42b0-88da-ce4d93e61311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c419d20f-874b-42b0-88da-ce4d93e61311', 'volume_size': 1} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338225591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419d20f-874b-42b0-88da-ce4d93e61311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:42Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume c419d20f-874b-42b0-88da-ce4d93e61311 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:42 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 1073741824 Jul 17 14:27:42 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:43 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 1073741824" returned: 0 in 0.737s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:43 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 Jul 17 14:27:43 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:43 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d5652c-1ebd-40fb-add2-1698fd50b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c419d20f-874b-42b0-88da-ce4d93e61311', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca29804-319d-4d50-976a-fa8dc1034bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-c419d20f-874b-42b0-88da-ce4d93e61311 (c419d20f-874b-42b0-88da-ce4d93e61311): created successfully Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca29804-319d-4d50-976a-fa8dc1034bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (268ce050-0ce1-4378-9307-20705463f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4e3a03e8-1219-4a14-bb1b-eb4d71a775a8 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (b61fd09e-fc94-486f-8449-3b1ad78d81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc0842-5ef5-4d77-a0c6-1b9844580ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc0842-5ef5-4d77-a0c6-1b9844580ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-477783297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f9e7-ee52-4be3-b244-7e601c4eae8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:45Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22904b71-5544-4266-91a7-13db7ef21b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22904b71-5544-4266-91a7-13db7ef21b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a7dea-50dc-45ec-908b-a4ac2c5aefde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a7dea-50dc-45ec-908b-a4ac2c5aefde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1408f9e7-ee52-4be3-b244-7e601c4eae8d', 'volume_name': 'volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70bbd18-8e92-44f3-a478-2a2c6f50ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70bbd18-8e92-44f3-a478-2a2c6f50ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f8fc8d-5c0e-41e1-a55f-abdbf85ffd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume 1408f9e7-ee52-4be3-b244-7e601c4eae8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d', 'volume_size': 1} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-477783297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f9e7-ee52-4be3-b244-7e601c4eae8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:45Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume 1408f9e7-ee52-4be3-b244-7e601c4eae8d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:45 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:45 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d 1073741824 Jul 17 14:27:45 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (b486aa48-3e7d-4d60-9bc8-9207c67e775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f6d39-4bca-4707-928b-55cbe583bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f6d39-4bca-4707-928b-55cbe583bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887553264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac22a82f-7d78-4de7-a771-89504e067956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:46Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b1e7b0-9d2a-427f-a8ca-3b237ff79918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b1e7b0-9d2a-427f-a8ca-3b237ff79918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb4221d-14ce-4ae8-b545-839145b27d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:46 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb4221d-14ce-4ae8-b545-839145b27d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac22a82f-7d78-4de7-a771-89504e067956', 'volume_name': 'volume-ac22a82f-7d78-4de7-a771-89504e067956', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22168e-0776-4334-ad9c-41bf4d3ebb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22168e-0776-4334-ad9c-41bf4d3ebb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc71ba-a07f-4f9e-a556-2a9e2278ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:46 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume ac22a82f-7d78-4de7-a771-89504e067956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac22a82f-7d78-4de7-a771-89504e067956', 'volume_size': 1} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d 1073741824" returned: 0 in 1.135s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:46 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d Jul 17 14:27:46 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (31226906-1ff8-4820-9238-6c78ead2f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c2505d-f006-48c8-9d3b-bbc6b755dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c2505d-f006-48c8-9d3b-bbc6b755dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322181882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4df6ee-7166-41b5-8544-efdd347b981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:47Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b7bd44-406c-4129-9e18-3ec3d7982165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b7bd44-406c-4129-9e18-3ec3d7982165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa1534-48a8-40ee-9789-5fee71c2f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa1534-48a8-40ee-9789-5fee71c2f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4df6ee-7166-41b5-8544-efdd347b981f', 'volume_name': 'volume-fa4df6ee-7166-41b5-8544-efdd347b981f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5753bb-4b9c-4bd3-9e05-64e1e066c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5753bb-4b9c-4bd3-9e05-64e1e066c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9a53c-715f-44a9-943e-6f8dd3447a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume fa4df6ee-7166-41b5-8544-efdd347b981f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4df6ee-7166-41b5-8544-efdd347b981f', 'volume_size': 1} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:47 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d" returned: 0 in 0.683s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887553264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac22a82f-7d78-4de7-a771-89504e067956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:46Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume ac22a82f-7d78-4de7-a771-89504e067956 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:47 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:47 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 1073741824 Jul 17 14:27:47 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f8fc8d-5c0e-41e1-a55f-abdbf85ffd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f9fd19-6e2e-42ca-9ef0-4708f47cd890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:47 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d (1408f9e7-ee52-4be3-b244-7e601c4eae8d): created successfully Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f9fd19-6e2e-42ca-9ef0-4708f47cd890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (b61fd09e-fc94-486f-8449-3b1ad78d81cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-11c9e0f5-9c8b-49f4-9887-aba8926612ea tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:47 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (a1022469-0542-4398-bd48-d463cd7ed0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1df2a06-0424-4b2d-abbb-4070e419375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1df2a06-0424-4b2d-abbb-4070e419375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235181754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff5db11-9287-4f97-a0b7-484aa510a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:48Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c41d68-cbad-4467-adba-5897909ac84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c41d68-cbad-4467-adba-5897909ac84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95885d-f98a-4476-aa85-4702a19acf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95885d-f98a-4476-aa85-4702a19acf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff5db11-9287-4f97-a0b7-484aa510a069', 'volume_name': 'volume-8ff5db11-9287-4f97-a0b7-484aa510a069', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c67dd6-fe22-44ca-9d4b-aebefaa4ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c67dd6-fe22-44ca-9d4b-aebefaa4ad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e89af6-45f8-4f61-a190-f056ff9bc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume 8ff5db11-9287-4f97-a0b7-484aa510a069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff5db11-9287-4f97-a0b7-484aa510a069', 'volume_size': 1} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (90d9fc18-e458-4e92-8393-cf6d9d6485ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97a82ab-4c5a-4a1c-8006-24b3c8c2fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 1073741824" returned: 0 in 1.116s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97a82ab-4c5a-4a1c-8006-24b3c8c2fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034461593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d616278-b203-4dd3-aa08-5e76e6d7d174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:48Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f24eaf-4292-4324-a7b5-6c911ed01333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f24eaf-4292-4324-a7b5-6c911ed01333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06aaabd-6ac6-4ecb-a39f-eeb5d66129d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06aaabd-6ac6-4ecb-a39f-eeb5d66129d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d616278-b203-4dd3-aa08-5e76e6d7d174', 'volume_name': 'volume-2d616278-b203-4dd3-aa08-5e76e6d7d174', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24f0270-b952-43d8-ae05-e41e823d44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24f0270-b952-43d8-ae05-e41e823d44ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f8080-0e65-4391-b884-068639572f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume 2d616278-b203-4dd3-aa08-5e76e6d7d174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d616278-b203-4dd3-aa08-5e76e6d7d174', 'volume_size': 1} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:48 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 Jul 17 14:27:48 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:49 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322181882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4df6ee-7166-41b5-8544-efdd347b981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:47Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume fa4df6ee-7166-41b5-8544-efdd347b981f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:49 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc71ba-a07f-4f9e-a556-2a9e2278ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac22a82f-7d78-4de7-a771-89504e067956', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad9aa6d-6f17-499c-b73e-c5fa5f40feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:49 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f 1073741824 Jul 17 14:27:49 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-ac22a82f-7d78-4de7-a771-89504e067956 (ac22a82f-7d78-4de7-a771-89504e067956): created successfully Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad9aa6d-6f17-499c-b73e-c5fa5f40feed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (b486aa48-3e7d-4d60-9bc8-9207c67e775a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4d659f40-5f93-4b46-8868-36d448759277 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:49 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f 1073741824" returned: 0 in 0.599s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:49 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f Jul 17 14:27:49 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:50 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235181754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff5db11-9287-4f97-a0b7-484aa510a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:48Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume 8ff5db11-9287-4f97-a0b7-484aa510a069 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:50 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:50 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 1073741824 Jul 17 14:27:50 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9a53c-715f-44a9-943e-6f8dd3447a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4df6ee-7166-41b5-8544-efdd347b981f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d36c0c5-f69b-4176-93d0-ce719c9f3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:50 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-fa4df6ee-7166-41b5-8544-efdd347b981f (fa4df6ee-7166-41b5-8544-efdd347b981f): created successfully Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d36c0c5-f69b-4176-93d0-ce719c9f3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (31226906-1ff8-4820-9238-6c78ead2f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-aa439e4a-bfd7-46a7-8969-6df4c7971983 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:51 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 1073741824" returned: 0 in 0.800s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:51 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 Jul 17 14:27:51 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:51 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.690s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034461593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d616278-b203-4dd3-aa08-5e76e6d7d174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce6c4fbc9384a2fb994b70cb92e808d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:48Z,use_quota=True,user_id='064eec8a4ed4411994e55f65893feb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Creating volume 2d616278-b203-4dd3-aa08-5e76e6d7d174 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:51 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e89af6-45f8-4f61-a190-f056ff9bc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff5db11-9287-4f97-a0b7-484aa510a069', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0303cc30-8bc8-4631-b613-8c0098bd38b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:51 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 1073741824 Jul 17 14:27:51 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:51 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-8ff5db11-9287-4f97-a0b7-484aa510a069 (8ff5db11-9287-4f97-a0b7-484aa510a069): created successfully Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0303cc30-8bc8-4631-b613-8c0098bd38b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (a1022469-0542-4398-bd48-d463cd7ed0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4c294366-34f2-46c7-ab31-832a839fe962 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:52 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 1073741824" returned: 0 in 0.628s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:52 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 Jul 17 14:27:52 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:52 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f8080-0e65-4391-b884-068639572f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d616278-b203-4dd3-aa08-5e76e6d7d174', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7cc486-e534-495b-ac86-afd117a5df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:52 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Volume volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 (2d616278-b203-4dd3-aa08-5e76e6d7d174): created successfully Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7cc486-e534-495b-ac86-afd117a5df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Flow 'volume_create_manager' (90d9fc18-e458-4e92-8393-cf6d9d6485ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-285c4121-606a-4f1d-96e7-8ac5468a5569 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created volume successfully. Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-2d616278-b203-4dd3-aa08-5e76e6d7d174-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-2d616278-b203-4dd3-aa08-5e76e6d7d174-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-2d616278-b203-4dd3-aa08-5e76e6d7d174" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-2d616278-b203-4dd3-aa08-5e76e6d7d174" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda838df-e2bf-4d28-a513-c0c882a444fa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:53 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 Jul 17 14:27:53 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:53 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174" returned: 0 in 0.420s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:53 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174 Jul 17 14:27:53 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:54 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d616278-b203-4dd3-aa08-5e76e6d7d174" returned: 0 in 0.301s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-2d616278-b203-4dd3-aa08-5e76e6d7d174" released by "delete_volume" :: held 0.766s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['5b56a74c-5106-4175-b294-5c95b14329b3', '11aba2dc-d2f9-4e4d-acbc-d1112db41750', 'ed85861e-9911-411e-8af4-3dd5015dd652', '31702b99-5258-4ecc-9479-8a5e004779dd'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:54 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:54 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-8ff5db11-9287-4f97-a0b7-484aa510a069-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-8ff5db11-9287-4f97-a0b7-484aa510a069-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-8ff5db11-9287-4f97-a0b7-484aa510a069" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-8ff5db11-9287-4f97-a0b7-484aa510a069" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4034db5f-d7ab-4939-bb76-1802bb7d10d4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:54 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:27:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e3c7a2ab-a130-4c70-a172-703255bca84d tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-2d616278-b203-4dd3-aa08-5e76e6d7d174-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:54 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 Jul 17 14:27:54 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:55 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069" returned: 0 in 0.520s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:55 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069 Jul 17 14:27:55 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:55 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8ff5db11-9287-4f97-a0b7-484aa510a069" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-8ff5db11-9287-4f97-a0b7-484aa510a069" released by "delete_volume" :: held 1.176s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:55 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['c07e5397-acb1-403f-beea-9b9aa607d7fc', '2cec0a0b-40a3-4b7f-82bc-2c06f6531067', '013de93b-3809-4e5f-9102-a4afab7ed455', '12288977-0cf9-473a-9549-1e8c6779e15d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Flow 'volume_create_manager' (1e91d8ec-b3f2-444f-8804-49a392f44262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f954cb6-a2cd-4e63-b779-fbef22ae5a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f954cb6-a2cd-4e63-b779-fbef22ae5a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-763255404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88055fe0-e697-4077-a784-ae19ec720426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c404667617d544699689fe8f81f48947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:56Z,use_quota=True,user_id='c2d3d3ebf3bb463a887ec7d6a7793935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8596840-2e66-4560-b444-038ab996a52f),volume_type_id=d8596840-2e66-4560-b444-038ab996a52f)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5bda0d-b65f-4e27-9cae-d54edd34d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5bda0d-b65f-4e27-9cae-d54edd34d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900e576d-6933-4b83-9837-ef050cae384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900e576d-6933-4b83-9837-ef050cae384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88055fe0-e697-4077-a784-ae19ec720426', 'volume_name': 'volume-88055fe0-e697-4077-a784-ae19ec720426', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10594de-ca5a-4eb6-a395-30afa29bdeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10594de-ca5a-4eb6-a395-30afa29bdeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f32a58d-bc8a-4046-9641-c94b8be41268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:56 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Volume 88055fe0-e697-4077-a784-ae19ec720426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88055fe0-e697-4077-a784-ae19ec720426', 'volume_size': 1} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-763255404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88055fe0-e697-4077-a784-ae19ec720426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c404667617d544699689fe8f81f48947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:27:56Z,use_quota=True,user_id='c2d3d3ebf3bb463a887ec7d6a7793935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8596840-2e66-4560-b444-038ab996a52f),volume_type_id=d8596840-2e66-4560-b444-038ab996a52f)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Creating volume 88055fe0-e697-4077-a784-ae19ec720426 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:27:56 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:56 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 1073741824 Jul 17 14:27:56 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:56 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:56 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-8cd01a68-7033-4e31-81bd-33d25f03fb40 req-229fdb1a-624e-40d4-8033-e56818ece7e5 tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:56 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5d90f635-e0f6-4016-84b7-76d0da1d2bd4 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-8ff5db11-9287-4f97-a0b7-484aa510a069-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:56 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 1073741824" returned: 0 in 0.547s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:56 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 Jul 17 14:27:56 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:57 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426" returned: 0 in 0.315s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-8cd01a68-7033-4e31-81bd-33d25f03fb40 req-229fdb1a-624e-40d4-8033-e56818ece7e5 tempest-TestStampPattern-1345969760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.684s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f32a58d-bc8a-4046-9641-c94b8be41268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88055fe0-e697-4077-a784-ae19ec720426', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b3d31-1ba7-4c18-ac95-4af7e3e5fc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-8cd01a68-7033-4e31-81bd-33d25f03fb40 req-229fdb1a-624e-40d4-8033-e56818ece7e5 tempest-TestStampPattern-1345969760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:57 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Volume volume-88055fe0-e697-4077-a784-ae19ec720426 (88055fe0-e697-4077-a784-ae19ec720426): created successfully Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b3d31-1ba7-4c18-ac95-4af7e3e5fc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Flow 'volume_create_manager' (1e91d8ec-b3f2-444f-8804-49a392f44262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:27:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-9cca576d-861a-471b-8f0d-b370570d6838 tempest-VolumeTypesAccessTest-1042953151 None] Created volume successfully. Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-8cd01a68-7033-4e31-81bd-33d25f03fb40 req-229fdb1a-624e-40d4-8033-e56818ece7e5 tempest-TestStampPattern-1345969760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-06379643-3994-4d99-994a-205ca0128747', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e533074-2915-4d74-ae2b-cdaf088572c1', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-fa4df6ee-7166-41b5-8544-efdd347b981f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-fa4df6ee-7166-41b5-8544-efdd347b981f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-8cd01a68-7033-4e31-81bd-33d25f03fb40 req-229fdb1a-624e-40d4-8033-e56818ece7e5 tempest-TestStampPattern-1345969760 None] attachment_update completed successfully. Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-fa4df6ee-7166-41b5-8544-efdd347b981f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-fa4df6ee-7166-41b5-8544-efdd347b981f" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5f415a-9f30-4e24-8d38-851a924d3078]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:57 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f Jul 17 14:27:57 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:58 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f" returned: 0 in 0.581s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:58 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f Jul 17 14:27:58 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Acquiring lock "cinder-88055fe0-e697-4077-a784-ae19ec720426-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "cinder-88055fe0-e697-4077-a784-ae19ec720426-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Acquiring lock "cinder-quobyte-88055fe0-e697-4077-a784-ae19ec720426" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "cinder-quobyte-88055fe0-e697-4077-a784-ae19ec720426" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:58 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fa4df6ee-7166-41b5-8544-efdd347b981f" returned: 0 in 0.495s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6458bf-19bb-4ffd-a423-744de4e0fbf0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-fa4df6ee-7166-41b5-8544-efdd347b981f" released by "delete_volume" :: held 1.172s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['4ba551f1-629c-44a3-922b-a802e7c5462f', 'a4276aac-1ee3-4b2a-bd6f-1cdd924879a6', 'abfc97a4-6ec1-4a73-a500-4dbcc85e07a2', '5bba2246-9056-4d41-a9be-d9b1d5b9a1e7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:58 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 Jul 17 14:27:58 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:58 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:58 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:59 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426" returned: 0 in 0.475s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:59 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.309s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:27:59 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426 Jul 17 14:27:59 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1b6a0414-7c6f-4ae0-bdff-a29e2b413ba0 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-fa4df6ee-7166-41b5-8544-efdd347b981f-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:59 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-88055fe0-e697-4077-a784-ae19ec720426" returned: 0 in 0.285s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "cinder-quobyte-88055fe0-e697-4077-a784-ae19ec720426" released by "delete_volume" :: held 0.831s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:59 devstack cinder-volume[87804]: WARNING cinder.quota [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2017625196 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2017625196, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:59 devstack cinder-volume[87804]: WARNING cinder.quota [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2017625196 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2017625196, it is now deprecated. Please use the default quota class for default quota. Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Created reservations ['f7803be8-a249-4b95-87fd-996b89940356', '19a36a36-b231-41fc-be5a-0b0516cc62e9', '496d17a0-127f-48d9-85af-2f1e42bbce46', 'b07fadf4-8066-4d74-af82-b0281af4553e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:59 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:27:59 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-ac22a82f-7d78-4de7-a771-89504e067956-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-ac22a82f-7d78-4de7-a771-89504e067956-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-ac22a82f-7d78-4de7-a771-89504e067956" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-ac22a82f-7d78-4de7-a771-89504e067956" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a269caa-6b2d-4d52-ad75-1c8f3ad0ea05]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:27:59 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.380s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:27:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Deleted volume successfully. Jul 17 14:27:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4c1f8497-7a9c-4da1-9823-55ed50e4db3a tempest-VolumeTypesAccessTest-1042953151 None] Lock "cinder-88055fe0-e697-4077-a784-ae19ec720426-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:27:59 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 Jul 17 14:27:59 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:00 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956" returned: 0 in 0.492s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:00 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956 Jul 17 14:28:00 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:00 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ac22a82f-7d78-4de7-a771-89504e067956" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-ac22a82f-7d78-4de7-a771-89504e067956" released by "delete_volume" :: held 0.874s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['6b6e8ad0-e709-4c73-abd0-0dcba0ad34ae', '2995de70-fd77-4512-ae49-93610f3f7331', '4cb4dfd6-50a1-4f5a-a0c0-178259ebafcc', 'b4387cd2-29ec-4d5e-b7ac-afd1922108b5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:00 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:00 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:01 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.289s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0cad259-8d70-43eb-b14d-1d844362b926 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-ac22a82f-7d78-4de7-a771-89504e067956-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-1408f9e7-ee52-4be3-b244-7e601c4eae8d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-1408f9e7-ee52-4be3-b244-7e601c4eae8d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-1408f9e7-ee52-4be3-b244-7e601c4eae8d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-1408f9e7-ee52-4be3-b244-7e601c4eae8d" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f4b43-9486-46ec-91ed-7ca86c47ae4e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:02 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d Jul 17 14:28:02 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:02 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d" returned: 0 in 0.466s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:02 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d Jul 17 14:28:02 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-85ee8125-3eaf-407c-a070-ed08d92d14a2 req-2d1a3ac6-6922-4a53-84f5-12dd941be0b4 tempest-TestStampPattern-1345969760 None] Terminate volume connection completed successfully. Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-85ee8125-3eaf-407c-a070-ed08d92d14a2 req-2d1a3ac6-6922-4a53-84f5-12dd941be0b4 tempest-TestStampPattern-1345969760 None] Deleting attachment 8e533074-2915-4d74-ae2b-cdaf088572c1. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:28:02 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-1408f9e7-ee52-4be3-b244-7e601c4eae8d" returned: 0 in 0.318s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-1408f9e7-ee52-4be3-b244-7e601c4eae8d" released by "delete_volume" :: held 0.850s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:02 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['395772a9-9c40-4fc1-8c03-770878fd0cc7', '44be4f68-334f-4072-b21a-2541b2574f3a', 'b126485d-cf73-423b-a3e2-c23230633272', '50b3a50b-8ce4-48fd-aff5-9f7130162ded'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:03 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:03 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-c419d20f-874b-42b0-88da-ce4d93e61311-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-c419d20f-874b-42b0-88da-ce4d93e61311-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "cinder-quobyte-c419d20f-874b-42b0-88da-ce4d93e61311" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-c419d20f-874b-42b0-88da-ce4d93e61311" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[24120d37-bcb4-4972-8bba-30c18078803f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:03 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a5656d10-93a6-48df-935f-c016bded502c tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-1408f9e7-ee52-4be3-b244-7e601c4eae8d-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:03 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 Jul 17 14:28:03 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Creating offline snapshot 9f2c971f-110c-42d9-8732-4be6adc06dc2 of volume 06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0e78e-c722-4016-bf25-1864ae8642cf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:03 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311" returned: 0 in 0.467s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:03 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311 Jul 17 14:28:03 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:03 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:28:03 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:04 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:04 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c419d20f-874b-42b0-88da-ce4d93e61311" returned: 0 in 0.325s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.419s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-quobyte-c419d20f-874b-42b0-88da-ce4d93e61311" released by "delete_volume" :: held 0.856s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:04 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 1G Jul 17 14:28:04 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Created reservations ['fc277335-defc-4277-9c24-4f50074ba177', 'bd61e238-2f17-49ac-95e0-0aeffc078b18', '35031eab-0fab-44f1-a3ea-d26dc24b0942', 'b76fbd72-6bd5-4bdd-9983-109c72bc8647'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:04 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:04 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:04 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.423s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Deleted volume successfully. Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46972d77-bf62-449d-8637-e13281ddd243 tempest-CreateVolumesFromSourceVolumeTest-660615838 None] Lock "cinder-c419d20f-874b-42b0-88da-ce4d93e61311-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:04 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 1G" returned: 0 in 0.651s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06379643-3994-4d99-994a-205ca0128747 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:04 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06379643-3994-4d99-994a-205ca0128747 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:28:04 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:05 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06379643-3994-4d99-994a-205ca0128747 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:05 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 is being set with open permissions: ugo+rw Jul 17 14:28:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:05 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:28:05 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:05 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:05 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info Jul 17 14:28:05 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:05 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:06 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info is being set with open permissions: ugo+rw Jul 17 14:28:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:06 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info Jul 17 14:28:06 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:06 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.info" returned: 0 in 0.316s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ae9caad5-2fc2-4773-bf4c-b81c1731102c tempest-TestStampPattern-1345969760 None] Create snapshot completed successfully Jul 17 14:28:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=113,cinder:UPDATE=130,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:28:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=114,cinder:UPDATE=127,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:28:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-a99f499a-74e5-42c2-99cd-fa836046c8eb req-8298ded8-6c03-4be4-88b1-d7ea75cb2759 tempest-TestShelveInstance-1315582905 None] Terminate volume connection completed successfully. Jul 17 14:28:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-a99f499a-74e5-42c2-99cd-fa836046c8eb req-8298ded8-6c03-4be4-88b1-d7ea75cb2759 tempest-TestShelveInstance-1315582905 None] Deleting attachment 97413e93-e803-44a8-a05c-d85eabd0cc51. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:28:11 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Flow 'volume_create_manager' (04617cbc-6e6e-40ea-9da8-573a5d775983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c96306-c4f4-491b-863d-732146071db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c96306-c4f4-491b-863d-732146071db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1370084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1feba0-aa0c-42f9-9a2c-5467fa9400c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72889501d76e4617afe30cfd157aca5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:12Z,use_quota=True,user_id='d42ca9837e4f44c28e9943cab2fae6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdce1718-b225-4b63-a05c-991f8f603c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdce1718-b225-4b63-a05c-991f8f603c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990a1079-4e7c-4ce7-a615-097b229e54cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990a1079-4e7c-4ce7-a615-097b229e54cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1feba0-aa0c-42f9-9a2c-5467fa9400c5', 'volume_name': 'volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7b42f-870a-436b-90c4-09e594ff3a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7b42f-870a-436b-90c4-09e594ff3a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88745b-33c1-4754-a050-d4057fcca44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Volume be1feba0-aa0c-42f9-9a2c-5467fa9400c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5', 'volume_size': 1} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1370084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1feba0-aa0c-42f9-9a2c-5467fa9400c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72889501d76e4617afe30cfd157aca5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:12Z,use_quota=True,user_id='d42ca9837e4f44c28e9943cab2fae6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Creating volume be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:28:12 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:12 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 1073741824 Jul 17 14:28:12 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:12 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 1073741824" returned: 0 in 0.617s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:12 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 Jul 17 14:28:12 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Flow 'volume_create_manager' (7ded2b49-1468-4da2-89c3-c85ea6047841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422d35b6-b89c-4bc5-9150-e1325f517faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422d35b6-b89c-4bc5-9150-e1325f517faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10544da6-e78a-42d1-893e-afb03630ac77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8b01c66e4622a76c300d58a0c38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:13Z,use_quota=True,user_id='3d938643144f46128fe2c6319a7db4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8e4349-c027-4d30-956f-fee389eab14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8e4349-c027-4d30-956f-fee389eab14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81075b9-02c0-4f2f-8f53-067a3e0902d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:12 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:28:13 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" returned: 0 in 0.331s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88745b-33c1-4754-a050-d4057fcca44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa31ded-1e53-47d7-8dec-e2c3f9abce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Volume volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 (be1feba0-aa0c-42f9-9a2c-5467fa9400c5): created successfully Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa31ded-1e53-47d7-8dec-e2c3f9abce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Flow 'volume_create_manager' (04617cbc-6e6e-40ea-9da8-573a5d775983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fb3a2d05-c09e-4161-a7bd-c31b7004f3af tempest-SnapshotMetadataTestJSON-694433516 None] Created volume successfully. Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81075b9-02c0-4f2f-8f53-067a3e0902d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10544da6-e78a-42d1-893e-afb03630ac77', 'volume_name': 'volume-10544da6-e78a-42d1-893e-afb03630ac77', 'volume_size': 1, 'image_id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a092cbfd1388b887bcbe27625c481ff6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4ec8b01c66e4622a76c300d58a0c38c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34eef4e7f8fe7c7f498dbe0573c8a46dc161608f0d65e1dc0a4441e107c176f2fc6c5611950e0d8e8febce6928e4f0c89fa9d3c72ab9e355fc92ded8e37a6efe', 'id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'created_at': datetime.datetime(2026, 7, 17, 12, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 28, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16200cb-9618-41f4-8468-436c36c4303f/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5e90e4-2bf4-4a35-aa90-65a86d2497e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5e90e4-2bf4-4a35-aa90-65a86d2497e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f1bc4c-c815-4f7a-98e4-3218f7f5f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Volume 10544da6-e78a-42d1-893e-afb03630ac77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10544da6-e78a-42d1-893e-afb03630ac77', 'volume_size': 1, 'image_id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a092cbfd1388b887bcbe27625c481ff6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4ec8b01c66e4622a76c300d58a0c38c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34eef4e7f8fe7c7f498dbe0573c8a46dc161608f0d65e1dc0a4441e107c176f2fc6c5611950e0d8e8febce6928e4f0c89fa9d3c72ab9e355fc92ded8e37a6efe', 'id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'created_at': datetime.datetime(2026, 7, 17, 12, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 28, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16200cb-9618-41f4-8468-436c36c4303f/file', 'properties': {}}, 'image_service': } Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Trying to clone 10544da6-e78a-42d1-893e-afb03630ac77 from image d16200cb-9618-41f4-8468-436c36c4303f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:28:13 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Image download 0.00 MB at 0.00 MB/s Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb3867-37cb-4387-8746-e761e6985f4c]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:13 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:13 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:13 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:14 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:14 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Creating offline snapshot ac374b75-8d3b-45cf-b2d5-154bb9a462ab of volume be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabe71c-e2d1-4f28-8d3d-6fb88faad419]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:14 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 1 in 0.530s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Temporary image d16200cb-9618-41f4-8468-436c36c4303f is fetched for user 3d938643144f46128fe2c6319a7db4da. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:28:14 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 Jul 17 14:28:14 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a48b5-d2e0-4a82-8df7-e7627d28d4d6]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:14 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:14 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b3b91801-e32e-4ebf-97d7-d4c3209f2294 req-e2b54801-7387-49f6-acbc-bb494735f8d0 tempest-TestShelveInstance-1315582905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:14 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:14 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab 1G Jul 17 14:28:14 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:15 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:15 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:15 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:15 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab 1G" returned: 0 in 0.492s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:15 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:15 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab Jul 17 14:28:15 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:15 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:15 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab is being set with open permissions: ugo+rw Jul 17 14:28:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:15 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab Jul 17 14:28:15 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:16 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:16 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info Jul 17 14:28:16 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:16 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info" returned: 0 in 0.270s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:16 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info is being set with open permissions: ugo+rw Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:16 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info Jul 17 14:28:16 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:16 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Flow 'volume_create_manager' (7cdb5947-4e32-459c-8279-16a4a48dafaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6dccf-9cc4-4e8a-8377-6302c9ed5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.info" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b3b91801-e32e-4ebf-97d7-d4c3209f2294 req-e2b54801-7387-49f6-acbc-bb494735f8d0 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.934s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6dccf-9cc4-4e8a-8377-6302c9ed5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1742808321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0084561c-09af-4ee0-ac4a-e84580720cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc8a872447c4f5a9748721c8c3724e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f2c971f-110c-42d9-8732-4be6adc06dc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:17Z,use_quota=True,user_id='aa96564565e643258f97a247c0d0f061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d52159-743c-4f6d-9a83-e2cb089b6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d52159-743c-4f6d-9a83-e2cb089b6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b918f-1860-4c3d-ba60-790bc13fad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b918f-1860-4c3d-ba60-790bc13fad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0084561c-09af-4ee0-ac4a-e84580720cf6', 'volume_name': 'volume-0084561c-09af-4ee0-ac4a-e84580720cf6', 'volume_size': 1, 'snapshot_id': '9f2c971f-110c-42d9-8732-4be6adc06dc2'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb38254d-553d-4ebe-bd21-d87a5e4f3dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb38254d-553d-4ebe-bd21-d87a5e4f3dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c385184-adb8-487f-8176-55b83a77a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Volume 0084561c-09af-4ee0-ac4a-e84580720cf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0084561c-09af-4ee0-ac4a-e84580720cf6', 'volume_size': 1, 'snapshot_id': '9f2c971f-110c-42d9-8732-4be6adc06dc2'} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-b3b91801-e32e-4ebf-97d7-d4c3209f2294 req-e2b54801-7387-49f6-acbc-bb494735f8d0 tempest-TestShelveInstance-1315582905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10544da6-e78a-42d1-893e-afb03630ac77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8b01c66e4622a76c300d58a0c38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:13Z,use_quota=True,user_id='3d938643144f46128fe2c6319a7db4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Creating volume 10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:28:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-da80d8c2-57c8-4a44-b19b-41917c0928ee tempest-SnapshotMetadataTestJSON-694433516 None] Create snapshot completed successfully Jul 17 14:28:16 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1073741824 Jul 17 14:28:16 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-b3b91801-e32e-4ebf-97d7-d4c3209f2294 req-e2b54801-7387-49f6-acbc-bb494735f8d0 tempest-TestShelveInstance-1315582905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-a195cef1-1bac-42b0-9382-5b17ef052cad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a02a8f99-1964-4efb-ad7f-f90a20fda072', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:28:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-b3b91801-e32e-4ebf-97d7-d4c3209f2294 req-e2b54801-7387-49f6-acbc-bb494735f8d0 tempest-TestShelveInstance-1315582905 None] attachment_update completed successfully. Jul 17 14:28:17 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1073741824" returned: 0 in 0.692s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:17 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 Jul 17 14:28:17 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:17 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77" returned: 0 in 0.389s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.176s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2-0084561c-09af-4ee0-ac4a-e84580720cf6" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2-0084561c-09af-4ee0-ac4a-e84580720cf6" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Creating volume 0084561c-09af-4ee0-ac4a-e84580720cf6 from snapshot 9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Attempting download of d16200cb-9618-41f4-8468-436c36c4303f ((None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}])) to volume 10544da6-e78a-42d1-893e-afb03630ac77. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] snapshot: 9f2c971f-110c-42d9-8732-4be6adc06dc2, volume: 0084561c-09af-4ee0-ac4a-e84580720cf6, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e5c62-9bfb-4c81-a30d-152145bafa20]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9103dc5-a13f-4c1d-9324-1693f31a89b5]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:18 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:28:18 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:18 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj Jul 17 14:28:18 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:18 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "cinder-ac374b75-8d3b-45cf-b2d5-154bb9a462ab-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.729s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06379643-3994-4d99-994a-205ca0128747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-ac374b75-8d3b-45cf-b2d5-154bb9a462ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce523c-5eca-47b1-b526-c93e03e60eea]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "cinder-quobyte-ac374b75-8d3b-45cf-b2d5-154bb9a462ab" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-ac374b75-8d3b-45cf-b2d5-154bb9a462ab" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Deleting offline snapshot ac374b75-8d3b-45cf-b2d5-154bb9a462ab of volume be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:28:19 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] snapshot_file for this snap is: volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj" returned: 0 in 0.859s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa53ce9-e0ed-4d88-9cd6-20272675686b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:19 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:28:19 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:19 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj Jul 17 14:28:19 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:19 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab Jul 17 14:28:19 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:19 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj" returned: 1 in 0.543s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16200cb-9618-41f4-8468-436c36c4303f_phnqg3pj' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab845b3-84b1-41cc-94e0-9a922e4307ec]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:19 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.712s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:19 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 Jul 17 14:28:19 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:19 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:19 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:19 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab" returned: 0 in 0.799s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da5c22f-5ea2-476c-818a-69d43745c55d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:20 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:20 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 Jul 17 14:28:20 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:20 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD Jul 17 14:28:20 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:20 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" returned: 0 in 0.814s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:20 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] d16200cb-9618-41f4-8468-436c36c4303f was raw, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:28:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:20 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab Jul 17 14:28:20 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:21 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 Jul 17 14:28:21 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:22 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab" returned: 0 in 1.350s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:22 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab Jul 17 14:28:22 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:22 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77" returned: 0 in 1.568s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:22 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d16200cb-9618-41f4-8468-436c36c4303f_y8rj4138devstack@QuobyteHD, size 0.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:28:22 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 14:28:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:22 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1G Jul 17 14:28:22 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:23 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5.ac374b75-8d3b-45cf-b2d5-154bb9a462ab" returned: 0 in 1.168s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-ac374b75-8d3b-45cf-b2d5-154bb9a462ab" released by "_delete_snapshot" :: held 4.501s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" released by "delete_snapshot" :: held 4.560s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:23 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Created reservations ['0fe6950d-d4e1-445f-9208-e4c6ebbb5281', '493378f2-0e01-4e4b-b74b-a6dc81d4a055', '643c3407-2cce-447d-8f9f-c9169a1767fd', '51cc0b75-e8fb-4b2a-bfa2-e590ac4eb1dc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:24 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 1G" returned: 0 in 1.591s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Downloaded image d16200cb-9618-41f4-8468-436c36c4303f ((None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}])) to volume 10544da6-e78a-42d1-893e-afb03630ac77 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Temporary image d16200cb-9618-41f4-8468-436c36c4303f for user 3d938643144f46128fe2c6319a7db4da is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Marking volume 10544da6-e78a-42d1-893e-afb03630ac77 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Copying metadata from image d16200cb-9618-41f4-8468-436c36c4303f to 10544da6-e78a-42d1-893e-afb03630ac77. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Creating volume glance metadata for volume 10544da6-e78a-42d1-893e-afb03630ac77 backed by image d16200cb-9618-41f4-8468-436c36c4303f with: {'image_id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a092cbfd1388b887bcbe27625c481ff6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:28:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Delete snapshot completed successfully. Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-73ecbb89-be4f-4761-b013-d4c8a01ee075 tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-ac374b75-8d3b-45cf-b2d5-154bb9a462ab-delete_snapshot" released by "delete_snapshot" :: held 5.380s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f1bc4c-c815-4f7a-98e4-3218f7f5f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10544da6-e78a-42d1-893e-afb03630ac77', 'volume_size': 1, 'image_id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16200cb-9618-41f4-8468-436c36c4303f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a092cbfd1388b887bcbe27625c481ff6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4ec8b01c66e4622a76c300d58a0c38c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34eef4e7f8fe7c7f498dbe0573c8a46dc161608f0d65e1dc0a4441e107c176f2fc6c5611950e0d8e8febce6928e4f0c89fa9d3c72ab9e355fc92ded8e37a6efe', 'id': 'd16200cb-9618-41f4-8468-436c36c4303f', 'created_at': datetime.datetime(2026, 7, 17, 12, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 28, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16200cb-9618-41f4-8468-436c36c4303f/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dba588-3999-49d2-ae78-b183a03b87ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:24 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Volume volume-10544da6-e78a-42d1-893e-afb03630ac77 (10544da6-e78a-42d1-893e-afb03630ac77): created successfully Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dba588-3999-49d2-ae78-b183a03b87ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Flow 'volume_create_manager' (7ded2b49-1468-4da2-89c3-c85ea6047841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-dc0d68ab-be8a-48eb-ad69-f6a6fa099959 tempest-VolumeImageDependencyTests-109217946 None] Created volume successfully. Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "cinder-be1feba0-aa0c-42f9-9a2c-5467fa9400c5-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-be1feba0-aa0c-42f9-9a2c-5467fa9400c5-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" acquired by "delete_volume" :: waited 0.042s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a464c7c2-2a04-4d93-bf65-ecb3f7c8067d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:25 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:25 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Acquiring lock "cinder-10544da6-e78a-42d1-893e-afb03630ac77-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "cinder-10544da6-e78a-42d1-893e-afb03630ac77-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:26 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 Jul 17 14:28:26 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Acquiring lock "cinder-quobyte-10544da6-e78a-42d1-893e-afb03630ac77" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "cinder-quobyte-10544da6-e78a-42d1-893e-afb03630ac77" acquired by "delete_volume" :: waited 0.046s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[332acf4c-e784-4462-bab0-066169f45ed5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:27 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 1.309s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:28:27 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 Jul 17 14:28:27 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:27 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" returned: 0 in 1.475s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:27 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5 Jul 17 14:28:27 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:27 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" returned: 0 in 0.627s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-quobyte-be1feba0-aa0c-42f9-9a2c-5467fa9400c5" released by "delete_volume" :: held 2.455s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Created reservations ['2efbd677-58ce-45d7-a81a-e7de90364362', 'd3b12196-2fea-48e6-8d99-0656c8e6a16f', '1655c071-8a64-472b-a4f7-69a7411fd473', 'ae7f5034-56e1-4513-98e6-fab3a0117e8b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:28 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77" returned: 0 in 2.039s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:28 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:28 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:28 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77 Jul 17 14:28:28 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:29 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6" returned: 0 in 9.950s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:29 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10544da6-e78a-42d1-893e-afb03630ac77" returned: 0 in 0.926s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7392bb-63e8-4a63-b105-c7d0b2469d31]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "cinder-quobyte-10544da6-e78a-42d1-893e-afb03630ac77" released by "delete_volume" :: held 3.177s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:29 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 1.098s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Deleted volume successfully. Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Created reservations ['258091b6-bc58-4e16-a23a-9ef423e452ab', '6e1a75db-2a1a-4970-bf6d-a0edfeb608bc', '47942b2d-9900-4b89-b55b-d66c5bbd5339', '985ead99-31e5-4b52-972c-0e2aab0c0ad1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-247e54dc-615a-4321-9f9f-7bac55484b0a tempest-SnapshotMetadataTestJSON-694433516 None] Lock "cinder-be1feba0-aa0c-42f9-9a2c-5467fa9400c5-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:29 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:28:29 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:30 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:30 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:30 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.604s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Deleted volume successfully. Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1c3d5047-7297-4e5d-a356-c6d44827ba26 tempest-VolumeImageDependencyTests-109217946 None] Lock "cinder-10544da6-e78a-42d1-893e-afb03630ac77-delete_volume" released by "delete_volume" :: held 4.677s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:30 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 1.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:28:30 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Converted 1024.00 MB image at 102.89 MB/s Jul 17 14:28:30 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 is being set with open permissions: ugo+rw Jul 17 14:28:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:31 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 Jul 17 14:28:31 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:31 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6" returned: 0 in 0.720s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" released by "_copy_volume_from_snapshot" :: held 13.586s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2-0084561c-09af-4ee0-ac4a-e84580720cf6" released by "_create_volume_from_snapshot" :: held 13.670s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.718s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c385184-adb8-487f-8176-55b83a77a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0084561c-09af-4ee0-ac4a-e84580720cf6', 'volume_size': 1, 'snapshot_id': '9f2c971f-110c-42d9-8732-4be6adc06dc2'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa422b2-b585-4136-9519-f32cc7f881e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Volume volume-0084561c-09af-4ee0-ac4a-e84580720cf6 (0084561c-09af-4ee0-ac4a-e84580720cf6): created successfully Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa422b2-b585-4136-9519-f32cc7f881e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Flow 'volume_create_manager' (7cdb5947-4e32-459c-8279-16a4a48dafaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3fd06e3a-f6f6-41d9-8176-d405349be43b tempest-TestStampPattern-1345969760 None] Created volume successfully. Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Flow 'volume_create_manager' (1a7ce9e0-f525-4840-9538-3bc1d0fc705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e2513f-6dbd-4ab9-ab54-f74dd0167283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e2513f-6dbd-4ab9-ab54-f74dd0167283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-201708851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e06c273-6e11-4e6e-90b2-f23c10f6a2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38eb627c0364db5809fb31977a65923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:39Z,use_quota=True,user_id='a13e588939764efbac330b0c8fb6abb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c726a-bf7a-441d-87f0-3c28fdc8f9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c726a-bf7a-441d-87f0-3c28fdc8f9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605153ae-9a88-44e6-a9a4-427e2c9154a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605153ae-9a88-44e6-a9a4-427e2c9154a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e06c273-6e11-4e6e-90b2-f23c10f6a2ba', 'volume_name': 'volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12501f36-a441-4f5f-984a-1d3f4cc6a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12501f36-a441-4f5f-984a-1d3f4cc6a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff918a8-009f-48d4-8639-2df1957e1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:39 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Volume 6e06c273-6e11-4e6e-90b2-f23c10f6a2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba', 'volume_size': 1} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-201708851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e06c273-6e11-4e6e-90b2-f23c10f6a2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38eb627c0364db5809fb31977a65923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:39Z,use_quota=True,user_id='a13e588939764efbac330b0c8fb6abb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Creating volume 6e06c273-6e11-4e6e-90b2-f23c10f6a2ba {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:28:39 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:28:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:39 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba 1073741824 Jul 17 14:28:39 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:40 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba 1073741824" returned: 0 in 1.036s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:40 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba Jul 17 14:28:40 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:41 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" returned: 0 in 0.515s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff918a8-009f-48d4-8639-2df1957e1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c49486-3cfe-4ff4-9a76-3335d398c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:41 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Volume volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba (6e06c273-6e11-4e6e-90b2-f23c10f6a2ba): created successfully Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c49486-3cfe-4ff4-9a76-3335d398c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Flow 'volume_create_manager' (1a7ce9e0-f525-4840-9538-3bc1d0fc705e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6aef92f0-f66b-49cc-8edb-68a389a4bc08 tempest-AbsoluteLimitsTests-1945619801 None] Created volume successfully. Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Acquiring lock "cinder-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "cinder-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Acquiring lock "cinder-quobyte-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "cinder-quobyte-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6627f0a-bff9-4291-aad8-9b8974e84e5a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:42 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba Jul 17 14:28:42 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:42 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" returned: 0 in 0.557s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:42 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba Jul 17 14:28:42 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:42 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" returned: 0 in 0.301s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "cinder-quobyte-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba" released by "delete_volume" :: held 0.941s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:42 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Created reservations ['d64d149d-3ff3-4d2f-86ae-321fd8ee4061', '4172a9a1-1fe3-4538-af10-849033ed6027', 'fb7e4a9e-2e07-4a94-a238-12fb87f31980', 'ac410ae0-ed14-4b02-9919-1fdb16653681'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:43 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:28:43 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:43 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.343s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:28:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Deleted volume successfully. Jul 17 14:28:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7fadfe93-a099-405f-bb61-e6664d27a41a tempest-AbsoluteLimitsTests-1945619801 None] Lock "cinder-6e06c273-6e11-4e6e-90b2-f23c10f6a2ba-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Flow 'volume_create_manager' (1f079c6c-1093-4b1d-aedc-2b7c95105287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7b301d-ece7-45a2-89bd-53d3acbef1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7b301d-ece7-45a2-89bd-53d3acbef1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-780617559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714dddb1-e3d1-4f8a-999f-551a212397ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd9fa584f0d4349be3a92a6b212493f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:49Z,use_quota=True,user_id='3f86b25eef6244bf9c161b3fbb78617d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39d400d-9fa1-476a-89d6-af43cbb4063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39d400d-9fa1-476a-89d6-af43cbb4063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c38d1b-0966-4302-8f59-91a8b6fa9423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c38d1b-0966-4302-8f59-91a8b6fa9423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714dddb1-e3d1-4f8a-999f-551a212397ba', 'volume_name': 'volume-714dddb1-e3d1-4f8a-999f-551a212397ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2098d6-3b5e-4780-a593-d64f7005818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2098d6-3b5e-4780-a593-d64f7005818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c03a42e-c1b1-49a0-813b-866d90359d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Volume 714dddb1-e3d1-4f8a-999f-551a212397ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714dddb1-e3d1-4f8a-999f-551a212397ba', 'volume_size': 1} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-780617559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714dddb1-e3d1-4f8a-999f-551a212397ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd9fa584f0d4349be3a92a6b212493f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:49Z,use_quota=True,user_id='3f86b25eef6244bf9c161b3fbb78617d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Creating volume 714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:28:48 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:28:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:48 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba 1073741824 Jul 17 14:28:48 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:49 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba 1073741824" returned: 0 in 0.475s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:49 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:28:49 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:49 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.280s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c03a42e-c1b1-49a0-813b-866d90359d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714dddb1-e3d1-4f8a-999f-551a212397ba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b504dd10-2603-4477-8572-75c98e7d1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Volume volume-714dddb1-e3d1-4f8a-999f-551a212397ba (714dddb1-e3d1-4f8a-999f-551a212397ba): created successfully Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b504dd10-2603-4477-8572-75c98e7d1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Flow 'volume_create_manager' (1f079c6c-1093-4b1d-aedc-2b7c95105287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-72b1f01b-0c57-439c-862e-eae56e90e9bb tempest-VolumesCloneTest-845230352 None] Created volume successfully. Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Flow 'volume_create_manager' (d3f955be-ff10-4017-882f-a11afd38ea95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c3f8d3-3d08-4921-afde-d01fdbc1c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c3f8d3-3d08-4921-afde-d01fdbc1c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1324283636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae404987-5553-4ee6-89b4-515e73fcd539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd9fa584f0d4349be3a92a6b212493f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:28:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=714dddb1-e3d1-4f8a-999f-551a212397ba,status='creating',terminated_at=None,updated_at=2026-07-17T12:28:51Z,use_quota=True,user_id='3f86b25eef6244bf9c161b3fbb78617d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4955eb1f-5178-47b8-809c-328035091710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4955eb1f-5178-47b8-809c-328035091710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f2460f-6f68-4582-8b6b-c605644d05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f2460f-6f68-4582-8b6b-c605644d05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae404987-5553-4ee6-89b4-515e73fcd539', 'volume_name': 'volume-ae404987-5553-4ee6-89b4-515e73fcd539', 'volume_size': 2, 'source_volid': '714dddb1-e3d1-4f8a-999f-551a212397ba', 'source_volstatus': 'available'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa777379-fabf-4fd9-bcde-ac729e87ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa777379-fabf-4fd9-bcde-ac729e87ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e5224-ba23-4154-acfe-8640e74cc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:28:51 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Volume ae404987-5553-4ee6-89b4-515e73fcd539: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae404987-5553-4ee6-89b4-515e73fcd539', 'volume_size': 2, 'source_volid': '714dddb1-e3d1-4f8a-999f-551a212397ba', 'source_volstatus': 'available'} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:51 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Cloning volume 714dddb1-e3d1-4f8a-999f-551a212397ba to volume ae404987-5553-4ee6-89b4-515e73fcd539 Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Creating offline snapshot a4e6641a-08a5-490d-9cea-0f2cad153a83 of volume 714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f485a3-b83e-41d2-be8e-8c59712224be]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:51 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:28:51 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:51 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:51 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 1G Jul 17 14:28:51 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:52 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 1G" returned: 0 in 0.427s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714dddb1-e3d1-4f8a-999f-551a212397ba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:52 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714dddb1-e3d1-4f8a-999f-551a212397ba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:28:52 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:52 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714dddb1-e3d1-4f8a-999f-551a212397ba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:52 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 is being set with open permissions: ugo+rw Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:52 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:28:52 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:52 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:53 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info Jul 17 14:28:53 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:53 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info" returned: 0 in 0.267s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:53 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info is being set with open permissions: ugo+rw Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:53 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info Jul 17 14:28:53 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:53 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.info" returned: 0 in 0.285s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] snapshot: a4e6641a-08a5-490d-9cea-0f2cad153a83, volume: ae404987-5553-4ee6-89b4-515e73fcd539, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2301026-aa3e-43be-9777-57ac1701451d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:53 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:28:53 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:54 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.400s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714dddb1-e3d1-4f8a-999f-551a212397ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b563bb-8f1a-4cf2-9117-53c3c88c854e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:54 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:28:54 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:54 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.442s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:28:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:54 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 Jul 17 14:28:54 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:58 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539" returned: 0 in 4.360s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8430d50-bcba-4354-a02f-ca43f241f288]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:58 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:28:58 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:59 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.533s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:28:59 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Converted 1024.00 MB image at 234.78 MB/s Jul 17 14:28:59 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 is being set with open permissions: ugo+rw Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:59 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 Jul 17 14:28:59 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:28:59 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" released by "_copy_volume_from_snapshot" :: held 6.074s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-quobyte-a4e6641a-08a5-490d-9cea-0f2cad153a83" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-a4e6641a-08a5-490d-9cea-0f2cad153a83" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Deleting offline snapshot a4e6641a-08a5-490d-9cea-0f2cad153a83 of volume 714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] snapshot_file for this snap is: volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[38238207-100f-416f-ac00-0f529b44cbb2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:28:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:28:59 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:28:59 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:00 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.392s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714dddb1-e3d1-4f8a-999f-551a212397ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d532d66e-901d-4b0a-88b0-abf2babf0e9c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:00 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:29:00 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:00 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.429s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:00 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:29:00 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:00 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.388s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:00 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83 Jul 17 14:29:00 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:01 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba.a4e6641a-08a5-490d-9cea-0f2cad153a83" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-a4e6641a-08a5-490d-9cea-0f2cad153a83" released by "_delete_snapshot" :: held 1.598s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.767s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e5224-ba23-4154-acfe-8640e74cc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae404987-5553-4ee6-89b4-515e73fcd539', 'volume_size': 2, 'source_volid': '714dddb1-e3d1-4f8a-999f-551a212397ba', 'source_volstatus': 'available'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740a2bf-efd5-48bd-af06-7ce64d0e0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Volume volume-ae404987-5553-4ee6-89b4-515e73fcd539 (ae404987-5553-4ee6-89b4-515e73fcd539): created successfully Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740a2bf-efd5-48bd-af06-7ce64d0e0b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Flow 'volume_create_manager' (d3f955be-ff10-4017-882f-a11afd38ea95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4768767d-d4e2-4971-9357-96a105a9de2e tempest-VolumesCloneTest-845230352 None] Created volume successfully. Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-ae404987-5553-4ee6-89b4-515e73fcd539-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "cinder-ae404987-5553-4ee6-89b4-515e73fcd539-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[50574580-a592-4469-9ccd-1ffa3268ab76]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:02 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 Jul 17 14:29:02 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:02 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539" returned: 0 in 0.392s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:02 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539 Jul 17 14:29:02 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:03 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae404987-5553-4ee6-89b4-515e73fcd539" returned: 0 in 0.285s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-ae404987-5553-4ee6-89b4-515e73fcd539" released by "delete_volume" :: held 0.725s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Created reservations ['20886b68-4416-4223-9c3b-389b28341c4d', 'db60d6c7-b608-4e5a-982c-b8560c4a4e07', 'e34e26d6-0c23-4f85-896e-f83b4c82dc84', '626f02d0-4859-4687-af2d-d6c91da1da69'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:03 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:03 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-714dddb1-e3d1-4f8a-999f-551a212397ba-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "cinder-714dddb1-e3d1-4f8a-999f-551a212397ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Acquiring lock "cinder-quobyte-714dddb1-e3d1-4f8a-999f-551a212397ba" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-714dddb1-e3d1-4f8a-999f-551a212397ba" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[77405557-2a35-489a-9a63-374af4ba1ae8]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:03 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.371s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Deleted volume successfully. Jul 17 14:29:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cedd0c65-df55-4848-bd6e-ac3e3a42de1e tempest-VolumesCloneTest-845230352 None] Lock "cinder-ae404987-5553-4ee6-89b4-515e73fcd539-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:03 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:29:03 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:04 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.466s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:04 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba Jul 17 14:29:04 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529a256-4b17-4bf0-9e7b-b0cb6404a642]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:04 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 Jul 17 14:29:04 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:04 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-714dddb1-e3d1-4f8a-999f-551a212397ba" returned: 0 in 0.278s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "cinder-quobyte-714dddb1-e3d1-4f8a-999f-551a212397ba" released by "delete_volume" :: held 0.833s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Created reservations ['aa792630-cff3-4274-9ef9-b89e776139d8', '827faae9-50e8-416d-a20d-5b3f52e669c5', '3d1989c1-4340-45dc-9fb3-31e29d037f36', '0524d3cf-2788-404d-babc-c641ec4779cb'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:04 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6" returned: 0 in 0.447s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.489s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:04 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:04 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:05 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Deleted volume successfully. Jul 17 14:29:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-0084561c-09af-4ee0-ac4a-e84580720cf6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af57ba1b-2b31-4aad-b85d-fb2a07315672', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:29:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-05fc57fe-51a0-4a7f-ad59-c41ef7bc863c tempest-VolumesCloneTest-845230352 None] Lock "cinder-714dddb1-e3d1-4f8a-999f-551a212397ba-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-322021ee-bca6-4642-982d-58c4a837d9c0 req-369e4860-046c-4b33-a466-9e27394dd74f tempest-TestStampPattern-1345969760 None] attachment_update completed successfully. Jul 17 14:29:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=77,cinder:UPDATE=62,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:29:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=60,cinder:UPDATE=79,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:29:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-7a56fb45-1337-4687-be85-748cebf13bf2 tempest-TestShelveInstance-1315582905 None] Terminate volume connection completed successfully. Jul 17 14:29:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-7a56fb45-1337-4687-be85-748cebf13bf2 tempest-TestShelveInstance-1315582905 None] Deleting attachment a02a8f99-1964-4efb-ad7f-f90a20fda072. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Acquiring lock "cinder-a195cef1-1bac-42b0-9382-5b17ef052cad-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "cinder-a195cef1-1bac-42b0-9382-5b17ef052cad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Acquiring lock "cinder-quobyte-a195cef1-1bac-42b0-9382-5b17ef052cad" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "cinder-quobyte-a195cef1-1bac-42b0-9382-5b17ef052cad" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7e33c-2c79-4b43-ad62-36e39134ff8b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:14 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad Jul 17 14:29:14 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (5f04e88f-0043-498f-a377-51494476cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73478e31-357d-4af5-b3e9-fe02ff2449c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73478e31-357d-4af5-b3e9-fe02ff2449c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-236738981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21754fe5-c669-4de2-912e-0caf8961aef1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:14Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0509bf-dfd2-48f7-9288-de19b867d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0509bf-dfd2-48f7-9288-de19b867d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89f7968-6a69-4e3c-aa1e-990c09ea7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89f7968-6a69-4e3c-aa1e-990c09ea7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21754fe5-c669-4de2-912e-0caf8961aef1', 'volume_name': 'volume-21754fe5-c669-4de2-912e-0caf8961aef1', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8872085f-14a8-46e9-b5be-051f7f326207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8872085f-14a8-46e9-b5be-051f7f326207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb78301a-6166-463d-bbc3-b36e3861dad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:14 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Volume 21754fe5-c669-4de2-912e-0caf8961aef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21754fe5-c669-4de2-912e-0caf8961aef1', 'volume_size': 1} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-236738981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21754fe5-c669-4de2-912e-0caf8961aef1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:14Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Creating volume 21754fe5-c669-4de2-912e-0caf8961aef1 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:14 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-c1688840-4482-474b-8862-6225986bbe60 req-f1ca5402-3129-47ea-91f4-b58ba21917a9 tempest-TestStampPattern-1345969760 None] Terminate volume connection completed successfully. Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-c1688840-4482-474b-8862-6225986bbe60 req-f1ca5402-3129-47ea-91f4-b58ba21917a9 tempest-TestStampPattern-1345969760 None] Deleting attachment af57ba1b-2b31-4aad-b85d-fb2a07315672. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:29:14 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 1073741824 Jul 17 14:29:14 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:14 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad" returned: 0 in 0.570s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:14 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad Jul 17 14:29:14 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:15 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a195cef1-1bac-42b0-9382-5b17ef052cad" returned: 0 in 0.370s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "cinder-quobyte-a195cef1-1bac-42b0-9382-5b17ef052cad" released by "delete_volume" :: held 1.024s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.quota [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Created reservations ['6a9da35a-f84a-49d1-b0f2-d708130ad646', '57112fcb-ce2b-44ba-9ad8-5bc96fbb889d', '3b1ffb69-e12b-464b-beff-8ca563846cfa', '08cdbe73-c069-4ae4-be7a-dcf3f4bc2fee'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:15 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 1073741824" returned: 0 in 0.663s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:15 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:15 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:15 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 Jul 17 14:29:15 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:15 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.269s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.manager [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Deleted volume successfully. Jul 17 14:29:15 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [req-ec94e611-8589-407e-8f07-0b88a0962cd7 req-9e47361d-c77c-46da-8eaf-4228af48db32 tempest-TestShelveInstance-1315582905 None] Lock "cinder-a195cef1-1bac-42b0-9382-5b17ef052cad-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1" returned: 0 in 0.289s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb78301a-6166-463d-bbc3-b36e3861dad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21754fe5-c669-4de2-912e-0caf8961aef1', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1db5e5-6641-41d0-9898-62daeade1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:15 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Volume volume-21754fe5-c669-4de2-912e-0caf8961aef1 (21754fe5-c669-4de2-912e-0caf8961aef1): created successfully Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1db5e5-6641-41d0-9898-62daeade1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:15 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (5f04e88f-0043-498f-a377-51494476cce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6a8b6e2c-91eb-419a-ac84-a848b77881e4 tempest-VolumesListTestJSON-1993278047 None] Created volume successfully. Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (4cb7b009-1e65-4998-9bef-97e0c265a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a2cd34-5b28-4905-b2c3-c663fc7f1d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a2cd34-5b28-4905-b2c3-c663fc7f1d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1852731555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c80937-49e2-46bb-ac49-f98a34d2532d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:17Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33165b3-f816-40ad-a5c2-c41e915ecb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33165b3-f816-40ad-a5c2-c41e915ecb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f49d6f-4dd7-442e-a8ad-cacb00a1c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f49d6f-4dd7-442e-a8ad-cacb00a1c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c80937-49e2-46bb-ac49-f98a34d2532d', 'volume_name': 'volume-f5c80937-49e2-46bb-ac49-f98a34d2532d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58eb050-afe8-461c-a0db-e0cb5b2e6006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58eb050-afe8-461c-a0db-e0cb5b2e6006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16684c72-ba16-40a6-ae99-b9b74b655b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Volume f5c80937-49e2-46bb-ac49-f98a34d2532d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c80937-49e2-46bb-ac49-f98a34d2532d', 'volume_size': 1} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1852731555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c80937-49e2-46bb-ac49-f98a34d2532d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:17Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Creating volume f5c80937-49e2-46bb-ac49-f98a34d2532d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:17 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:17 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d 1073741824 Jul 17 14:29:17 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:18 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d 1073741824" returned: 0 in 0.718s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:18 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d Jul 17 14:29:18 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:18 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16684c72-ba16-40a6-ae99-b9b74b655b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c80937-49e2-46bb-ac49-f98a34d2532d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51d7bb7-6c55-4a93-95f3-8f8c750a92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Volume volume-f5c80937-49e2-46bb-ac49-f98a34d2532d (f5c80937-49e2-46bb-ac49-f98a34d2532d): created successfully Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51d7bb7-6c55-4a93-95f3-8f8c750a92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (4cb7b009-1e65-4998-9bef-97e0c265a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-20bb6a5a-e470-4354-ad60-1ae3aca09873 tempest-VolumesListTestJSON-1993278047 None] Created volume successfully. Jul 17 14:29:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-0084561c-09af-4ee0-ac4a-e84580720cf6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "cinder-0084561c-09af-4ee0-ac4a-e84580720cf6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf879d-d2c7-4ed0-bfbe-09909800e9a8]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (6cf59877-e6dd-4286-9b2c-f92d993e5be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677e95f0-27bd-47e9-ad9a-98ad171347f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677e95f0-27bd-47e9-ad9a-98ad171347f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1132893875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120306f-076d-4e3d-8c7f-82ff9d8e038b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:20Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163dd53-3cee-403f-8f1c-485631dbdc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163dd53-3cee-403f-8f1c-485631dbdc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e01cdb-9f2a-4a55-9016-58c70041a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e01cdb-9f2a-4a55-9016-58c70041a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f120306f-076d-4e3d-8c7f-82ff9d8e038b', 'volume_name': 'volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7385fddc-9ba8-4e83-ab77-4a0b1f38fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7385fddc-9ba8-4e83-ab77-4a0b1f38fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31370a-4653-42d8-a17d-8cff0fa2255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Volume f120306f-076d-4e3d-8c7f-82ff9d8e038b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b', 'volume_size': 1} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1132893875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120306f-076d-4e3d-8c7f-82ff9d8e038b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cba108bd33d4f83941a81a090df2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:20Z,use_quota=True,user_id='8ad4079452b1457b99bac73326f046b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Creating volume f120306f-076d-4e3d-8c7f-82ff9d8e038b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:20 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:20 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b 1073741824 Jul 17 14:29:20 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:20 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 Jul 17 14:29:20 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:20 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6" returned: 0 in 0.604s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:20 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6 Jul 17 14:29:20 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:20 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b 1073741824" returned: 0 in 0.601s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:20 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b Jul 17 14:29:20 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:20 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0084561c-09af-4ee0-ac4a-e84580720cf6" returned: 0 in 0.306s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-0084561c-09af-4ee0-ac4a-e84580720cf6" released by "delete_volume" :: held 0.982s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Created reservations ['b107b68b-fccc-4d65-9746-5283f070a1e3', 'f52ed687-0be5-47c4-87ec-16ba0e1588ac', '49736696-7966-4418-bac2-a33db5ed542c', '9c3e3f1e-ffc4-4784-b302-95fa47bceae1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:21 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b" returned: 0 in 0.358s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:21 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:21 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31370a-4653-42d8-a17d-8cff0fa2255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698c450-798a-4391-a105-8580a5e2a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Volume volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b (f120306f-076d-4e3d-8c7f-82ff9d8e038b): created successfully Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698c450-798a-4391-a105-8580a5e2a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Flow 'volume_create_manager' (6cf59877-e6dd-4286-9b2c-f92d993e5be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7fcd9dbc-d795-47f1-b1d7-805f69815d51 tempest-VolumesListTestJSON-1993278047 None] Created volume successfully. Jul 17 14:29:21 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.273s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Deleted volume successfully. Jul 17 14:29:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f2a888c0-234a-4552-bae4-add810742f40 tempest-TestStampPattern-1345969760 None] Lock "cinder-0084561c-09af-4ee0-ac4a-e84580720cf6-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-9f2c971f-110c-42d9-8732-4be6adc06dc2-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-9f2c971f-110c-42d9-8732-4be6adc06dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Deleting offline snapshot 9f2c971f-110c-42d9-8732-4be6adc06dc2 of volume 06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] snapshot_file for this snap is: volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009fbf0-924b-49a2-af24-db22ba84ad12]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:22 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:29:22 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:23 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.453s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06379643-3994-4d99-994a-205ca0128747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9306b-d6aa-4fcc-b2d2-69b59bef3758]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:23 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:29:23 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:23 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.493s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:23 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:29:23 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:24 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:24 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2 Jul 17 14:29:24 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:24 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747.9f2c971f-110c-42d9-8732-4be6adc06dc2" returned: 0 in 0.326s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-9f2c971f-110c-42d9-8732-4be6adc06dc2" released by "_delete_snapshot" :: held 1.913s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-f120306f-076d-4e3d-8c7f-82ff9d8e038b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" released by "delete_snapshot" :: held 1.951s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-f120306f-076d-4e3d-8c7f-82ff9d8e038b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-quobyte-f120306f-076d-4e3d-8c7f-82ff9d8e038b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-f120306f-076d-4e3d-8c7f-82ff9d8e038b" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Created reservations ['a75a5d27-5869-483f-9af8-53cc9f3c6718', '9c961ecf-3998-4a35-b526-027a52d50e83', '92ef935d-d59b-4e92-bf0a-7f7165232304', 'c70efa2f-6bb9-4713-b41c-0500b7fab83c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36c58b-0d2b-44ba-a026-c87de1333b55]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Delete snapshot completed successfully. Jul 17 14:29:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ed8710a3-8851-452c-914c-83999d34e9c4 tempest-TestStampPattern-1345969760 None] Lock "cinder-9f2c971f-110c-42d9-8732-4be6adc06dc2-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:24 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b Jul 17 14:29:24 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:25 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b" returned: 0 in 0.437s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:25 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b Jul 17 14:29:25 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:25 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f120306f-076d-4e3d-8c7f-82ff9d8e038b" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-f120306f-076d-4e3d-8c7f-82ff9d8e038b" released by "delete_volume" :: held 0.863s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Created reservations ['aea89622-4dd0-45ca-95cb-12dc8e684eb2', '20c05125-c330-4575-8b01-3e24025a2645', '9c437cd7-9bd9-4151-a46b-1ee7b912e361', '030f8d68-e4e3-4535-b91a-7b799e5aebb3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:25 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:25 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:25 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:25 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-f5c80937-49e2-46bb-ac49-f98a34d2532d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-f5c80937-49e2-46bb-ac49-f98a34d2532d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-quobyte-f5c80937-49e2-46bb-ac49-f98a34d2532d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-f5c80937-49e2-46bb-ac49-f98a34d2532d" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1de3e-870b-4eb6-92cc-fef4dee594e8]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:26 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.427s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:26 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.380s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Deleted volume successfully. Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e8e46dc6-0a74-4964-a7c2-89d6ec62dcb8 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-f120306f-076d-4e3d-8c7f-82ff9d8e038b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:26 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d Jul 17 14:29:26 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:26 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d" returned: 0 in 0.496s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:26 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d Jul 17 14:29:26 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:26 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f5c80937-49e2-46bb-ac49-f98a34d2532d" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-f5c80937-49e2-46bb-ac49-f98a34d2532d" released by "delete_volume" :: held 0.916s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Created reservations ['b541899f-227a-4270-ad5d-6f1561b7b17a', '02c7b9ca-fc68-4505-b130-586e29160f89', 'a5633554-b7e0-44a4-9005-ab5ffb03a35c', '565e7424-e9b6-4d3f-a1be-2c7f078cb1c2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:27 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:27 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:27 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.458s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Deleted volume successfully. Jul 17 14:29:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0191fbf-0001-4f31-8551-14d5ff5aafde tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-f5c80937-49e2-46bb-ac49-f98a34d2532d-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-21754fe5-c669-4de2-912e-0caf8961aef1-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-21754fe5-c669-4de2-912e-0caf8961aef1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "cinder-quobyte-21754fe5-c669-4de2-912e-0caf8961aef1" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-21754fe5-c669-4de2-912e-0caf8961aef1" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c12c71-0123-4c7a-a9f0-ccfd53309620]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:28 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 Jul 17 14:29:28 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:29 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1" returned: 0 in 0.643s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:29 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1 Jul 17 14:29:29 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:29 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-21754fe5-c669-4de2-912e-0caf8961aef1" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-quobyte-21754fe5-c669-4de2-912e-0caf8961aef1" released by "delete_volume" :: held 1.047s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Created reservations ['8b19112c-b0c9-4f84-9360-beeb9a688f7a', 'fe2e562f-e984-4d3a-b2ba-1628d4ad41fd', '86568ccc-698d-43f7-91a5-14af5df19b30', 'f29f5819-088c-4f17-8d6b-356040f32bd3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:29 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:29 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:29 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:29 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Deleted volume successfully. Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-2ce76048-cec9-4e9f-90bf-c09db2257be4 tempest-VolumesListTestJSON-1993278047 None] Lock "cinder-21754fe5-c669-4de2-912e-0caf8961aef1-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-06379643-3994-4d99-994a-205ca0128747-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "cinder-06379643-3994-4d99-994a-205ca0128747-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Acquiring lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c54a5c4-35c0-449f-8293-c451be29b993]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:30 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:29:30 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:30 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.476s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:30 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747 Jul 17 14:29:30 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:31 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06379643-3994-4d99-994a-205ca0128747" returned: 0 in 0.284s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "cinder-quobyte-06379643-3994-4d99-994a-205ca0128747" released by "delete_volume" :: held 0.852s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Created reservations ['a92d4d6a-297f-4f23-a3bf-d60a33082cd0', 'a34331c1-68dd-4e5e-be60-c382adc18d89', 'b80a0b38-4439-4803-b45b-7e57fc02e307', '1f673891-a22a-419f-a866-6513973296c3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:31 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:31 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:31 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.399s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Deleted volume successfully. Jul 17 14:29:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38566e2e-8748-4faa-a7d2-6799a1e22ba2 tempest-TestStampPattern-1345969760 None] Lock "cinder-06379643-3994-4d99-994a-205ca0128747-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Flow 'volume_create_manager' (b3cb610d-cc5f-40a7-90c2-33997a322d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9df57a-c9ac-4c54-9e44-759770f738eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9df57a-c9ac-4c54-9e44-759770f738eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f53334-154a-4620-9ca0-afeb877dedb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe14660fb6342c6a9687889019469e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:32Z,use_quota=True,user_id='08b0f25503464f1888b1c34536e1acb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04d570-1820-4556-8b5c-2c076777646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04d570-1820-4556-8b5c-2c076777646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd87c4-f137-458f-b10e-c6628548bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd87c4-f137-458f-b10e-c6628548bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f53334-154a-4620-9ca0-afeb877dedb3', 'volume_name': 'volume-97f53334-154a-4620-9ca0-afeb877dedb3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301f533d-071c-4258-aa9e-0b752940ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301f533d-071c-4258-aa9e-0b752940ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0418c4-f9c7-404a-8b0d-ad4cf964e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Volume 97f53334-154a-4620-9ca0-afeb877dedb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f53334-154a-4620-9ca0-afeb877dedb3', 'volume_size': 1} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f53334-154a-4620-9ca0-afeb877dedb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe14660fb6342c6a9687889019469e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:32Z,use_quota=True,user_id='08b0f25503464f1888b1c34536e1acb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Creating volume 97f53334-154a-4620-9ca0-afeb877dedb3 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:32 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:32 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 1073741824 Jul 17 14:29:32 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:33 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 1073741824" returned: 0 in 0.621s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:33 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 Jul 17 14:29:33 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:33 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3" returned: 0 in 0.322s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0418c4-f9c7-404a-8b0d-ad4cf964e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f53334-154a-4620-9ca0-afeb877dedb3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a72bf32-9452-4bad-be2d-9ca4528a968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:33 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Volume volume-97f53334-154a-4620-9ca0-afeb877dedb3 (97f53334-154a-4620-9ca0-afeb877dedb3): created successfully Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a72bf32-9452-4bad-be2d-9ca4528a968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Flow 'volume_create_manager' (b3cb610d-cc5f-40a7-90c2-33997a322d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1f3fc191-26ab-4328-aa2e-4f7ada208112 tempest-CinderUnicodeTest-1254246798 None] Created volume successfully. Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Flow 'volume_create_manager' (c56ac5ba-5239-463c-b997-83550bd6b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edfea45-3381-4517-8994-3e0e066cb9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edfea45-3381-4517-8994-3e0e066cb9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1555289980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe86ecc-dce7-4ead-9057-f82a567a981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe14660fb6342c6a9687889019469e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:35Z,use_quota=True,user_id='08b0f25503464f1888b1c34536e1acb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f00a3-5848-474b-9005-4c1d904d94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f00a3-5848-474b-9005-4c1d904d94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684fa24d-0b66-443f-93d5-a2ec944450f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684fa24d-0b66-443f-93d5-a2ec944450f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe86ecc-dce7-4ead-9057-f82a567a981f', 'volume_name': 'volume-bbe86ecc-dce7-4ead-9057-f82a567a981f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974e1df-7dd4-49bb-965d-d213af0993d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974e1df-7dd4-49bb-965d-d213af0993d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a34957-fbbe-41dd-b63d-4a44e544f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:35 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Volume bbe86ecc-dce7-4ead-9057-f82a567a981f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe86ecc-dce7-4ead-9057-f82a567a981f', 'volume_size': 1} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1555289980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe86ecc-dce7-4ead-9057-f82a567a981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe14660fb6342c6a9687889019469e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:35Z,use_quota=True,user_id='08b0f25503464f1888b1c34536e1acb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Creating volume bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:35 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:35 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f 1073741824 Jul 17 14:29:35 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:36 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f 1073741824" returned: 0 in 0.535s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:36 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f Jul 17 14:29:36 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:36 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f" returned: 0 in 0.316s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a34957-fbbe-41dd-b63d-4a44e544f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe86ecc-dce7-4ead-9057-f82a567a981f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dff934-25e6-456e-98eb-ed7014b74d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:36 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Volume volume-bbe86ecc-dce7-4ead-9057-f82a567a981f (bbe86ecc-dce7-4ead-9057-f82a567a981f): created successfully Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dff934-25e6-456e-98eb-ed7014b74d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:36 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Flow 'volume_create_manager' (c56ac5ba-5239-463c-b997-83550bd6b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ae5ffb6b-6660-46a1-a126-2fd35dab80c9 tempest-CinderUnicodeTest-1254246798 None] Created volume successfully. Jul 17 14:29:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Creating offline snapshot dc28eff3-a5d0-4730-bbd7-b77b357a2432 of volume bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:29:37 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b5e6a-fc8a-43fe-a483-579380008bca]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:37 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f Jul 17 14:29:37 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:38 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f" returned: 0 in 0.418s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:38 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 1G Jul 17 14:29:38 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:38 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 1G" returned: 0 in 0.480s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbe86ecc-dce7-4ead-9057-f82a567a981f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:38 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbe86ecc-dce7-4ead-9057-f82a567a981f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 Jul 17 14:29:38 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:38 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbe86ecc-dce7-4ead-9057-f82a567a981f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432" returned: 0 in 0.371s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:38 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 is being set with open permissions: ugo+rw Jul 17 14:29:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:38 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 Jul 17 14:29:38 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:39 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432" returned: 0 in 0.309s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:39 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info Jul 17 14:29:39 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:39 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info" returned: 0 in 0.286s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:39 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info is being set with open permissions: ugo+rw Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:39 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info Jul 17 14:29:39 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:39 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.info" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7aae46ef-4b98-4d84-947b-3227354ccb43 tempest-CinderUnicodeTest-1254246798 None] Create snapshot completed successfully Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-dc28eff3-a5d0-4730-bbd7-b77b357a2432-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-dc28eff3-a5d0-4730-bbd7-b77b357a2432-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-quobyte-dc28eff3-a5d0-4730-bbd7-b77b357a2432" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-dc28eff3-a5d0-4730-bbd7-b77b357a2432" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Deleting offline snapshot dc28eff3-a5d0-4730-bbd7-b77b357a2432 of volume bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:29:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] snapshot_file for this snap is: volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d100f-2820-45db-8f0e-1b0c7061fa42]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:41 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 Jul 17 14:29:41 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:41 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432" returned: 0 in 0.456s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbe86ecc-dce7-4ead-9057-f82a567a981f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b1df9f-5925-48fe-918a-82cbfcbac57c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:41 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f Jul 17 14:29:41 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:42 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f" returned: 0 in 0.519s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:42 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 Jul 17 14:29:42 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:42 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432" returned: 0 in 0.426s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:42 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432 Jul 17 14:29:42 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:42 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f.dc28eff3-a5d0-4730-bbd7-b77b357a2432" returned: 0 in 0.294s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-dc28eff3-a5d0-4730-bbd7-b77b357a2432" released by "_delete_snapshot" :: held 1.899s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" released by "delete_snapshot" :: held 1.926s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:42 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Created reservations ['11450230-da29-41d8-9f9b-ff95b94e02e7', 'f848ed48-8099-4b4a-9bd4-0c4102edf607', '1cd3bfbe-4623-4d3e-9bf4-fba5fe8aebf1', '947babec-74f9-4e66-b10c-715f9ea9417c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Delete snapshot completed successfully. Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-607543fd-96c3-452d-8ce0-ba9ad1a3c042 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-dc28eff3-a5d0-4730-bbd7-b77b357a2432-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-bbe86ecc-dce7-4ead-9057-f82a567a981f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-bbe86ecc-dce7-4ead-9057-f82a567a981f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db94bdc-c850-488b-b57f-7d1727bff979]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:43 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f Jul 17 14:29:43 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:43 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f" returned: 0 in 0.477s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:43 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f Jul 17 14:29:43 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:44 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-bbe86ecc-dce7-4ead-9057-f82a567a981f" returned: 0 in 0.360s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-bbe86ecc-dce7-4ead-9057-f82a567a981f" released by "delete_volume" :: held 0.947s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Created reservations ['04385aa2-16e7-4ff0-873b-6d335a022e1c', '24b5ed29-de0f-4ba6-9b70-2c424b99d462', 'b9444613-0e8a-4a33-b9ed-c5cf18860b64', '1c377f1c-3fcb-479c-b7ff-6489d7565b0a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:44 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:44 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:44 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Deleted volume successfully. Jul 17 14:29:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ef7a21fb-5d14-4332-9c99-01e7cdb57468 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-bbe86ecc-dce7-4ead-9057-f82a567a981f-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-97f53334-154a-4620-9ca0-afeb877dedb3-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-97f53334-154a-4620-9ca0-afeb877dedb3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "cinder-quobyte-97f53334-154a-4620-9ca0-afeb877dedb3" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-97f53334-154a-4620-9ca0-afeb877dedb3" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1059c98a-59a1-4267-800f-eba58aa95d65]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:45 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 Jul 17 14:29:45 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:46 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3" returned: 0 in 0.492s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:46 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3 Jul 17 14:29:46 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:46 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-97f53334-154a-4620-9ca0-afeb877dedb3" returned: 0 in 0.432s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-quobyte-97f53334-154a-4620-9ca0-afeb877dedb3" released by "delete_volume" :: held 0.998s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (ad7b3360-10ef-48dd-bdb7-76d0cb402075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6bb304-bb3f-40cd-b354-2637270b395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6bb304-bb3f-40cd-b354-2637270b395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568995713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55abdc1d-fc61-4d87-8ced-d67a4baa73b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:47Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1804329e-d257-4991-9b2d-6e3450f18ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1804329e-d257-4991-9b2d-6e3450f18ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c800005-b958-4163-a258-b119a60024a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c800005-b958-4163-a258-b119a60024a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55abdc1d-fc61-4d87-8ced-d67a4baa73b2', 'volume_name': 'volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec928d33-cc76-48ac-a992-8d78ca2016ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec928d33-cc76-48ac-a992-8d78ca2016ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea811e2f-5435-4acb-8211-f2008f7a9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:46 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Volume 55abdc1d-fc61-4d87-8ced-d67a4baa73b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2', 'volume_size': 1} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568995713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55abdc1d-fc61-4d87-8ced-d67a4baa73b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:47Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Creating volume 55abdc1d-fc61-4d87-8ced-d67a4baa73b2 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:46 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:46 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 1073741824 Jul 17 14:29:46 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:46 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Created reservations ['6a4fda61-434a-435a-858a-7c56da7bcda1', 'aba0a5e1-7b0b-4b0f-a665-ee16eb78f7f8', '273b6981-2bf9-456f-8d6e-c2b0b42c672a', 'f49353be-0eb2-47fa-9cd8-639fd277763e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:47 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:47 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (b3939735-a917-4101-91b0-56dc1a20c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb570e84-f0ad-408e-a9e0-d6cae22e33a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb570e84-f0ad-408e-a9e0-d6cae22e33a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99851083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc71aa-f93f-4423-8baa-a480b747d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:47Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63caed2-89a4-4a5b-86a7-4c8b5fb9c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63caed2-89a4-4a5b-86a7-4c8b5fb9c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f98f40a-3ba1-4443-81ea-38030c3df41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f98f40a-3ba1-4443-81ea-38030c3df41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbc71aa-f93f-4423-8baa-a480b747d16d', 'volume_name': 'volume-0dbc71aa-f93f-4423-8baa-a480b747d16d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a368c7-2f05-4a8f-9d55-88878a5eaee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a368c7-2f05-4a8f-9d55-88878a5eaee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1220ce-cddc-4813-b879-6246000a9fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:47 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Volume 0dbc71aa-f93f-4423-8baa-a480b747d16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbc71aa-f93f-4423-8baa-a480b747d16d', 'volume_size': 1} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:47 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.444s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Deleted volume successfully. Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-43c4edcd-4d22-4363-b4fa-0d8a64620d99 tempest-CinderUnicodeTest-1254246798 None] Lock "cinder-97f53334-154a-4620-9ca0-afeb877dedb3-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:47 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 1073741824" returned: 0 in 0.860s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:47 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 Jul 17 14:29:47 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (93a85668-6584-4621-b769-024d28db5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5356cb3-f179-4939-931c-0b8e620cff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5356cb3-f179-4939-931c-0b8e620cff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018112986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6db7f-273a-456b-b855-77ec5b63b69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:48Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b45850-40ef-40f3-85de-ea2e141eae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b45850-40ef-40f3-85de-ea2e141eae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6896655-19f7-4264-8d7d-69ce4de95b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6896655-19f7-4264-8d7d-69ce4de95b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca6db7f-273a-456b-b855-77ec5b63b69d', 'volume_name': 'volume-5ca6db7f-273a-456b-b855-77ec5b63b69d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20268fde-3b28-46b0-a55f-6edcdee1ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20268fde-3b28-46b0-a55f-6edcdee1ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a30421e-33df-4b37-8d5e-d7502a47272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Volume 5ca6db7f-273a-456b-b855-77ec5b63b69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca6db7f-273a-456b-b855-77ec5b63b69d', 'volume_size': 1} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:48 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99851083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc71aa-f93f-4423-8baa-a480b747d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:47Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Creating volume 0dbc71aa-f93f-4423-8baa-a480b747d16d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:48 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea811e2f-5435-4acb-8211-f2008f7a9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e2bf90-88cb-4690-b53d-8f17a969cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d 1073741824 Jul 17 14:29:48 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Volume volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 (55abdc1d-fc61-4d87-8ced-d67a4baa73b2): created successfully Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e2bf90-88cb-4690-b53d-8f17a969cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (ad7b3360-10ef-48dd-bdb7-76d0cb402075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1551e133-d4e6-4d66-9bb3-8a998ffd3421 tempest-CreateVolumesFromImageTest-1086365421 None] Created volume successfully. Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (919befad-d1d2-4175-86a4-59eb6a023a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bf5b72-1b80-4578-a614-8e5433a2c605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bf5b72-1b80-4578-a614-8e5433a2c605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-652336231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dad02f5-dd05-4ab5-8be7-df65979735b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634ac1b3-c64e-4165-8feb-1e53182e12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634ac1b3-c64e-4165-8feb-1e53182e12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af763f9e-5ddd-4eb7-ab3a-0254261fc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af763f9e-5ddd-4eb7-ab3a-0254261fc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dad02f5-dd05-4ab5-8be7-df65979735b3', 'volume_name': 'volume-3dad02f5-dd05-4ab5-8be7-df65979735b3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d9329a-9066-4dc4-b474-4cb975777da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d9329a-9066-4dc4-b474-4cb975777da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d073afbb-acf8-4c55-9477-64c1a67285b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:48 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Volume 3dad02f5-dd05-4ab5-8be7-df65979735b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dad02f5-dd05-4ab5-8be7-df65979735b3', 'volume_size': 1} Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:48 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d 1073741824" returned: 0 in 0.738s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:49 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d Jul 17 14:29:49 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (683f39f6-3284-4493-83b1-2acd12ab3ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d35f3b-50df-464e-a215-995f21564a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d35f3b-50df-464e-a215-995f21564a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096856046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01077773-f381-4b9c-b7d7-e8482960b8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8707f5-c55e-4d79-9d11-fc672ad3ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8707f5-c55e-4d79-9d11-fc672ad3ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6a2021-fce1-4d68-a4fe-7f3c4eb31535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6a2021-fce1-4d68-a4fe-7f3c4eb31535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01077773-f381-4b9c-b7d7-e8482960b8e9', 'volume_name': 'volume-01077773-f381-4b9c-b7d7-e8482960b8e9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaa0091-9eb5-481c-bd6e-2cebeddd4e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaa0091-9eb5-481c-bd6e-2cebeddd4e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6783be-a823-443e-b21d-fe2b84e14baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume 01077773-f381-4b9c-b7d7-e8482960b8e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01077773-f381-4b9c-b7d7-e8482960b8e9', 'volume_size': 1} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018112986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6db7f-273a-456b-b855-77ec5b63b69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:48Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Creating volume 5ca6db7f-273a-456b-b855-77ec5b63b69d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:49 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1220ce-cddc-4813-b879-6246000a9fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbc71aa-f93f-4423-8baa-a480b747d16d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d 1073741824 Jul 17 14:29:49 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a346b-bcf0-4c16-aaf4-3c71a93a19d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (8d09ff05-62f3-49be-b7eb-615b0717e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96682c1f-01f7-4a9a-ac04-da9c2cbfe7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Volume volume-0dbc71aa-f93f-4423-8baa-a480b747d16d (0dbc71aa-f93f-4423-8baa-a480b747d16d): created successfully Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a346b-bcf0-4c16-aaf4-3c71a93a19d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (b3939735-a917-4101-91b0-56dc1a20c822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96682c1f-01f7-4a9a-ac04-da9c2cbfe7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714524581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953d64f1-824f-4943-aacd-896158be6f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599a3a0a-4126-4bcc-a7a1-25ef0364f19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599a3a0a-4126-4bcc-a7a1-25ef0364f19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8133c3-9ff2-450b-81c6-bbb7c2fdc199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8133c3-9ff2-450b-81c6-bbb7c2fdc199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953d64f1-824f-4943-aacd-896158be6f3f', 'volume_name': 'volume-953d64f1-824f-4943-aacd-896158be6f3f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b03b70-77ed-42c3-a69f-c3de2eac4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b03b70-77ed-42c3-a69f-c3de2eac4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f4a858-53fc-4ca9-afe0-d6fb9f4aaa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Volume 953d64f1-824f-4943-aacd-896158be6f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953d64f1-824f-4943-aacd-896158be6f3f', 'volume_size': 1} Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-784524cf-e6b5-4015-8712-bcbb3321e753 tempest-CreateVolumesFromImageTest-1086365421 None] Created volume successfully. Jul 17 14:29:49 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d 1073741824" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:50 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d Jul 17 14:29:50 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:50 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d" returned: 0 in 0.261s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-652336231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dad02f5-dd05-4ab5-8be7-df65979735b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Creating volume 3dad02f5-dd05-4ab5-8be7-df65979735b3 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:50 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a30421e-33df-4b37-8d5e-d7502a47272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca6db7f-273a-456b-b855-77ec5b63b69d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043603b7-0d80-428b-b250-dec2400b2e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:50 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 1073741824 Jul 17 14:29:50 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:50 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Volume volume-5ca6db7f-273a-456b-b855-77ec5b63b69d (5ca6db7f-273a-456b-b855-77ec5b63b69d): created successfully Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043603b7-0d80-428b-b250-dec2400b2e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (93a85668-6584-4621-b769-024d28db5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-376b11a1-ce8d-4450-8927-cb804738cae9 tempest-CreateVolumesFromImageTest-1086365421 None] Created volume successfully. Jul 17 14:29:50 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 1073741824" returned: 0 in 0.497s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:50 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 Jul 17 14:29:50 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:51 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3" returned: 0 in 0.298s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096856046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01077773-f381-4b9c-b7d7-e8482960b8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Creating volume 01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:51 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d073afbb-acf8-4c55-9477-64c1a67285b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dad02f5-dd05-4ab5-8be7-df65979735b3', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:51 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 1073741824 Jul 17 14:29:51 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239f8fa-e3a2-471a-b331-29221f0200dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:51 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Volume volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 (3dad02f5-dd05-4ab5-8be7-df65979735b3): created successfully Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239f8fa-e3a2-471a-b331-29221f0200dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (919befad-d1d2-4175-86a4-59eb6a023a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-63f58d98-834d-46ef-9eee-390638cc6bfc tempest-CreateVolumesFromImageTest-1086365421 None] Created volume successfully. Jul 17 14:29:51 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 1073741824" returned: 0 in 0.536s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:51 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 Jul 17 14:29:51 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:52 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9" returned: 0 in 0.276s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714524581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953d64f1-824f-4943-aacd-896158be6f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff6d42ea9c548f1801c4e01b61c83b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:49Z,use_quota=True,user_id='31c4164b0da940cd8bda74b892a2cb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Creating volume 953d64f1-824f-4943-aacd-896158be6f3f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:52 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6783be-a823-443e-b21d-fe2b84e14baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01077773-f381-4b9c-b7d7-e8482960b8e9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:52 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f 1073741824 Jul 17 14:29:52 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c80949-6027-441f-a494-ad0958056d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:52 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume volume-01077773-f381-4b9c-b7d7-e8482960b8e9 (01077773-f381-4b9c-b7d7-e8482960b8e9): created successfully Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c80949-6027-441f-a494-ad0958056d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (683f39f6-3284-4493-83b1-2acd12ab3ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-731622ac-ea29-4986-8e08-77ecbb56b969 tempest-VolumesSnapshotTestJSON-1277454658 None] Created volume successfully. Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:52 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f 1073741824" returned: 0 in 0.648s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:52 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f Jul 17 14:29:52 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:52 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f" returned: 0 in 0.275s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.373s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f4a858-53fc-4ca9-afe0-d6fb9f4aaa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953d64f1-824f-4943-aacd-896158be6f3f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dc6677-5a5a-4a47-989b-2fa0bff937ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Creating offline snapshot 6b59d52a-8472-4178-8170-185f9d89e243 of volume 01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:29:53 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Volume volume-953d64f1-824f-4943-aacd-896158be6f3f (953d64f1-824f-4943-aacd-896158be6f3f): created successfully Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dc6677-5a5a-4a47-989b-2fa0bff937ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Flow 'volume_create_manager' (8d09ff05-62f3-49be-b7eb-615b0717e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd2dc5c-b558-4edc-bf9d-f07060644b52]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2b2b3a23-bbc8-4770-a1c1-073cc3bc2c3e tempest-CreateVolumesFromImageTest-1086365421 None] Created volume successfully. Jul 17 14:29:53 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 Jul 17 14:29:53 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:53 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9" returned: 0 in 0.424s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:53 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 1G Jul 17 14:29:53 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-953d64f1-824f-4943-aacd-896158be6f3f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-953d64f1-824f-4943-aacd-896158be6f3f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-quobyte-953d64f1-824f-4943-aacd-896158be6f3f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-953d64f1-824f-4943-aacd-896158be6f3f" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eada40-823c-46ad-91de-0d861e6ddb8c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f Jul 17 14:29:54 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 1G" returned: 0 in 0.594s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01077773-f381-4b9c-b7d7-e8482960b8e9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01077773-f381-4b9c-b7d7-e8482960b8e9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 Jul 17 14:29:54 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f" returned: 0 in 0.513s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f Jul 17 14:29:54 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01077773-f381-4b9c-b7d7-e8482960b8e9 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243" returned: 0 in 0.399s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:54 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 is being set with open permissions: ugo+rw Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 Jul 17 14:29:54 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-953d64f1-824f-4943-aacd-896158be6f3f" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-953d64f1-824f-4943-aacd-896158be6f3f" released by "delete_volume" :: held 0.855s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Created reservations ['9deed745-accb-4db2-b7cd-834ef12af23a', 'f681b101-02d3-4956-921d-ee688604e0b1', 'e45e6862-6544-434f-bc12-1cc61ee5f408', '2cff2251-cd61-4b9b-bf61-8acf541c254d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:54 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243" returned: 0 in 0.302s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:54 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:54 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info Jul 17 14:29:54 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-3dad02f5-dd05-4ab5-8be7-df65979735b3-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-3dad02f5-dd05-4ab5-8be7-df65979735b3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-quobyte-3dad02f5-dd05-4ab5-8be7-df65979735b3" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-3dad02f5-dd05-4ab5-8be7-df65979735b3" acquired by "delete_volume" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792d474-902e-43a0-9f55-5c010ed0c10f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:55 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info" returned: 0 in 0.345s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:55 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info is being set with open permissions: ugo+rw Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:55 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Deleted volume successfully. Jul 17 14:29:55 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info Jul 17 14:29:55 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8edd8473-b930-4c5c-ae0e-2cbe6824051f tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-953d64f1-824f-4943-aacd-896158be6f3f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:55 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 Jul 17 14:29:55 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:55 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.info" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:55 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3" returned: 0 in 0.442s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:55 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2901a991-4f9c-447e-9e0b-f08772933563 tempest-VolumesSnapshotTestJSON-1277454658 None] Create snapshot completed successfully Jul 17 14:29:55 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3 Jul 17 14:29:55 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:55 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-3dad02f5-dd05-4ab5-8be7-df65979735b3" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-6b59d52a-8472-4178-8170-185f9d89e243-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-3dad02f5-dd05-4ab5-8be7-df65979735b3" released by "delete_volume" :: held 0.802s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-6b59d52a-8472-4178-8170-185f9d89e243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-6b59d52a-8472-4178-8170-185f9d89e243" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Created reservations ['cdee0ddc-a1fe-4b24-9ac7-22bf0dd46f34', 'fe6fb82b-373d-468c-b2fc-1f6b1ef61d6c', '4bbe2281-2a23-49b5-8d05-1c651d594715', '953f2137-450a-41de-933e-126129fb5372'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b59d52a-8472-4178-8170-185f9d89e243" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Deleting offline snapshot 6b59d52a-8472-4178-8170-185f9d89e243 of volume 01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] snapshot_file for this snap is: volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521f333-3372-4bb4-a719-1e9e3100dc93]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:56 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:56 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:56 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 Jul 17 14:29:56 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-5ca6db7f-273a-456b-b855-77ec5b63b69d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-5ca6db7f-273a-456b-b855-77ec5b63b69d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-quobyte-5ca6db7f-273a-456b-b855-77ec5b63b69d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-5ca6db7f-273a-456b-b855-77ec5b63b69d" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[76167210-6d4b-470c-ae9e-441ea83a6833]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:56 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Deleted volume successfully. Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8f41f41f-6b96-4f6b-8a79-95aeb05eb37e tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-3dad02f5-dd05-4ab5-8be7-df65979735b3-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:56 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243" returned: 0 in 0.537s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01077773-f381-4b9c-b7d7-e8482960b8e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:29:56 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d Jul 17 14:29:56 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a0c121-cd01-415b-b7de-ad096fcb94fa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:56 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 Jul 17 14:29:56 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:56 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d" returned: 0 in 0.454s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:57 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d Jul 17 14:29:57 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:57 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9" returned: 0 in 0.430s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:57 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 Jul 17 14:29:57 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:57 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-5ca6db7f-273a-456b-b855-77ec5b63b69d" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-5ca6db7f-273a-456b-b855-77ec5b63b69d" released by "delete_volume" :: held 0.808s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Created reservations ['fbee1b5f-7a97-4e10-8ff8-1a4c32386fea', 'ecc50705-4186-469b-abc7-ed79916f9b64', 'ef2e2986-4146-4609-b76b-19518694869c', '123fff58-3d43-497e-8849-00b0231c2832'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:57 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:57 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-0dbc71aa-f93f-4423-8baa-a480b747d16d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-0dbc71aa-f93f-4423-8baa-a480b747d16d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-quobyte-0dbc71aa-f93f-4423-8baa-a480b747d16d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-0dbc71aa-f93f-4423-8baa-a480b747d16d" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:57 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243" returned: 0 in 0.575s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b62c7-3335-4282-8bed-e25402790caa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:57 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243 Jul 17 14:29:57 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:57 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.360s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Deleted volume successfully. Jul 17 14:29:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-280f0a36-aa06-4ddd-a801-9470e69d0d43 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-5ca6db7f-273a-456b-b855-77ec5b63b69d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:57 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d Jul 17 14:29:57 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:58 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9.6b59d52a-8472-4178-8170-185f9d89e243" returned: 0 in 0.302s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b59d52a-8472-4178-8170-185f9d89e243" released by "_delete_snapshot" :: held 1.998s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" released by "delete_snapshot" :: held 2.030s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['47af9c62-d5f5-4e7e-b946-14f43ffc37b3', '092658c6-f70a-4f65-9670-fc847446af3d', 'e59c64cd-d4c4-46e6-99a4-fd9cd8beaebb', '6d13d0ca-4fed-4b5f-a017-f20f29e5a196'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:58 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (6216c154-2b39-44e3-a10d-c4e1e0637b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6237923b-49d4-4564-b5a5-cb8cdea72587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d" returned: 0 in 0.512s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6237923b-49d4-4564-b5a5-cb8cdea72587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102056276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb70d677-3e7f-4ced-9fc7-b8e6217c89cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:58Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ed4e18-c692-43d3-9ca8-6524e7db74ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:58 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d Jul 17 14:29:58 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ed4e18-c692-43d3-9ca8-6524e7db74ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb3d3c2-bcb7-4eb3-91f7-5fa4234280be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb3d3c2-bcb7-4eb3-91f7-5fa4234280be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb70d677-3e7f-4ced-9fc7-b8e6217c89cc', 'volume_name': 'volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a98f57-c231-4154-8ec2-89dc5f7a0a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a98f57-c231-4154-8ec2-89dc5f7a0a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e9a97d-cf61-4009-9593-4b9e2c5b973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Volume fb70d677-3e7f-4ced-9fc7-b8e6217c89cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc', 'volume_size': 1} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102056276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb70d677-3e7f-4ced-9fc7-b8e6217c89cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:29:58Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Creating volume fb70d677-3e7f-4ced-9fc7-b8e6217c89cc {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:58 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Delete snapshot completed successfully. Jul 17 14:29:58 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc 1073741824 Jul 17 14:29:58 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b6a4f492-de18-4c02-9f0d-0ebe00f5eab7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-6b59d52a-8472-4178-8170-185f9d89e243-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:58 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0dbc71aa-f93f-4423-8baa-a480b747d16d" returned: 0 in 0.267s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-0dbc71aa-f93f-4423-8baa-a480b747d16d" released by "delete_volume" :: held 0.847s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Created reservations ['a7cbd37a-e74c-457c-a797-7fdf6fe4b31b', 'e1daaf2d-b504-4a4c-92e7-f991180be4cf', '59b3e39f-6a39-4cdf-a3b0-2466449efcdf', '7859c297-c151-4db2-b726-3517f81e4115'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:58 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:29:58 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:58 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-55abdc1d-fc61-4d87-8ced-d67a4baa73b2-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc 1073741824" returned: 0 in 0.509s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-55abdc1d-fc61-4d87-8ced-d67a4baa73b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:58 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "cinder-quobyte-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:29:58 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:29:58 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:29:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Deleted volume successfully. Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65bde04-4af6-4826-87c0-33629ca5afd7]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:29:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6fcee910-17a5-4376-a686-4507797db059 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-0dbc71aa-f93f-4423-8baa-a480b747d16d-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:59 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 Jul 17 14:29:59 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:59 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" returned: 0 in 0.324s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e9a97d-cf61-4009-9593-4b9e2c5b973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816e7569-604a-48a8-8458-4ebb6172a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Volume volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc (fb70d677-3e7f-4ced-9fc7-b8e6217c89cc): created successfully Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816e7569-604a-48a8-8458-4ebb6172a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (6216c154-2b39-44e3-a10d-c4e1e0637b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6c8ea0e4-adcd-4a57-94f3-ca2e62d86bfd tempest-ProjectReaderTests-1812300001 None] Created volume successfully. Jul 17 14:29:59 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" returned: 0 in 0.508s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:29:59 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2 Jul 17 14:29:59 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:29:59 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-quobyte-55abdc1d-fc61-4d87-8ced-d67a4baa73b2" released by "delete_volume" :: held 0.873s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (c6c21aac-1908-4404-aa4c-92cdc5ce722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381887a9-a9ff-40d5-987f-10bd557c3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Created reservations ['dfedc849-b916-4433-a251-4c997fea60a4', 'b9aebf18-38fb-4564-923e-6445c394923c', 'eebb661e-eefa-4e77-857a-1524639d6763', '7cb81edb-b8d3-44e4-b100-8d1c2ab36ae7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381887a9-a9ff-40d5-987f-10bd557c3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-532723393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b004c38-77ca-462c-a467-4ff62a8212f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:00Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71080b5c-cdea-499f-b829-50bece1c6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71080b5c-cdea-499f-b829-50bece1c6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d34689-594b-497d-b356-5e97b265ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d34689-594b-497d-b356-5e97b265ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b004c38-77ca-462c-a467-4ff62a8212f7', 'volume_name': 'volume-6b004c38-77ca-462c-a467-4ff62a8212f7', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6da48d2-5ad3-4f08-a256-bd2dccedd760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6da48d2-5ad3-4f08-a256-bd2dccedd760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf2c05-e1a4-4199-aec7-33e667f0de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:29:59 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume 6b004c38-77ca-462c-a467-4ff62a8212f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b004c38-77ca-462c-a467-4ff62a8212f7', 'volume_size': 1} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-532723393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b004c38-77ca-462c-a467-4ff62a8212f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:00Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Creating volume 6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:29:59 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:29:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:00 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 1073741824 Jul 17 14:30:00 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:00 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:00 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:00 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.289s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Deleted volume successfully. Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2d742c7-297b-4556-9d88-296966842d41 tempest-CreateVolumesFromImageTest-1086365421 None] Lock "cinder-55abdc1d-fc61-4d87-8ced-d67a4baa73b2-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:00 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 1073741824" returned: 0 in 0.549s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:00 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:00 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-quobyte-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b68346-7188-4168-9dd2-5de89175179d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:00 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc Jul 17 14:30:00 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:00 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf2c05-e1a4-4199-aec7-33e667f0de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b004c38-77ca-462c-a467-4ff62a8212f7', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c43a456-ef35-4b76-8797-4e52b704ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:00 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume volume-6b004c38-77ca-462c-a467-4ff62a8212f7 (6b004c38-77ca-462c-a467-4ff62a8212f7): created successfully Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c43a456-ef35-4b76-8797-4e52b704ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (c6c21aac-1908-4404-aa4c-92cdc5ce722f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4c937aaa-637b-4b14-b1c6-f050798ef795 tempest-VolumesSnapshotTestJSON-1277454658 None] Created volume successfully. Jul 17 14:30:01 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" returned: 0 in 0.433s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:01 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc Jul 17 14:30:01 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:01 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc" released by "delete_volume" :: held 0.780s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Created reservations ['68a6683c-270a-4545-9623-3894e4df65fe', '01c71ccc-59e3-4f13-bb2c-ca63f76d42b1', '28a9ea6c-19ad-40da-9d1b-29b21391191f', '4707a704-e2ad-40d2-b28d-5dc21955bdff'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:01 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:01 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:01 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.327s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:01 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Deleted volume successfully. Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-53ecbbbf-6047-4298-951d-0960527dd636 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-fb70d677-3e7f-4ced-9fc7-b8e6217c89cc-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (7587aa16-cea6-4e0e-a618-fdefe58584f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae825745-2c96-404e-9043-56ecc771c31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Creating offline snapshot ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 of volume 6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae825745-2c96-404e-9043-56ecc771c31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1036271205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0697d8-2b6c-4641-8bf5-2b43f4ac94d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:02Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516ab7b-8952-4721-a8e9-9019d503c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516ab7b-8952-4721-a8e9-9019d503c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504cd693-53c6-4f54-b811-4ea864d73f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504cd693-53c6-4f54-b811-4ea864d73f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0697d8-2b6c-4641-8bf5-2b43f4ac94d5', 'volume_name': 'volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91286e91-eb9e-45ae-9eb5-3e6f8f1075aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91286e91-eb9e-45ae-9eb5-3e6f8f1075aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78885515-6ce0-46ef-bb37-12d9b95dfc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Volume af0697d8-2b6c-4641-8bf5-2b43f4ac94d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5', 'volume_size': 1} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7038d-4016-46f9-9864-3e549a7988ae]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:02 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:02 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:03 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:03 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 1G Jul 17 14:30:03 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:03 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 1G" returned: 0 in 0.537s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b004c38-77ca-462c-a467-4ff62a8212f7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:03 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b004c38-77ca-462c-a467-4ff62a8212f7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:03 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:03 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b004c38-77ca-462c-a467-4ff62a8212f7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.325s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:03 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 is being set with open permissions: ugo+rw Jul 17 14:30:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:03 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:03 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:04 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.273s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:04 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info Jul 17 14:30:04 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:04 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info" returned: 0 in 0.298s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:04 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info is being set with open permissions: ugo+rw Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:04 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info Jul 17 14:30:04 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:04 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.info" returned: 0 in 0.241s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1036271205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0697d8-2b6c-4641-8bf5-2b43f4ac94d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:02Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Creating volume af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:04 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:30:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:04 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 1073741824 Jul 17 14:30:04 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e67104fa-457f-40d0-832e-173b1fd8ff1e tempest-VolumesSnapshotTestJSON-1277454658 None] Create snapshot completed successfully Jul 17 14:30:05 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 1073741824" returned: 0 in 0.456s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:05 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 Jul 17 14:30:05 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:05 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" returned: 0 in 0.285s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78885515-6ce0-46ef-bb37-12d9b95dfc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4220078c-fe4b-42a5-a1e3-29d8f87491af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:05 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Volume volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 (af0697d8-2b6c-4641-8bf5-2b43f4ac94d5): created successfully Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4220078c-fe4b-42a5-a1e3-29d8f87491af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (7587aa16-cea6-4e0e-a618-fdefe58584f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c46cd9da-907c-41a8-970f-d9c4f6ccc3ba tempest-ProjectReaderTests-1812300001 None] Created volume successfully. Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (591ddffd-75bf-4e73-91a5-e81cc3afdf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc16cf-9b43-4ac5-a5f4-eb85152f5136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc16cf-9b43-4ac5-a5f4-eb85152f5136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1740871927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23537a3c-ff5a-4519-9515-a461c145a22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:06Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a30f90-3413-4cb3-9f4f-215c7532ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a30f90-3413-4cb3-9f4f-215c7532ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d45607-3db2-4434-af55-217d037d2587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d45607-3db2-4434-af55-217d037d2587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23537a3c-ff5a-4519-9515-a461c145a22e', 'volume_name': 'volume-23537a3c-ff5a-4519-9515-a461c145a22e', 'volume_size': 2, 'snapshot_id': 'ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f367f3c-1829-4048-bc80-16da2a0696f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f367f3c-1829-4048-bc80-16da2a0696f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f13e89b-9e23-4e3c-98eb-2cacd93579dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:06 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Volume 23537a3c-ff5a-4519-9515-a461c145a22e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23537a3c-ff5a-4519-9515-a461c145a22e', 'volume_size': 2, 'snapshot_id': 'ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5'} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-23537a3c-ff5a-4519-9515-a461c145a22e" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-23537a3c-ff5a-4519-9515-a461c145a22e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Creating volume 23537a3c-ff5a-4519-9515-a461c145a22e from snapshot ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] snapshot: ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5, volume: 23537a3c-ff5a-4519-9515-a461c145a22e, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f06a8-8abb-4ff0-a0b7-2c6a73e46515]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:06 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:06 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:06 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.441s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b004c38-77ca-462c-a467-4ff62a8212f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c1dac-65e3-4665-906c-4d537128ff32]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-quobyte-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c665b300-165e-4dbc-a400-b31aa5f4fb66]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:06 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:06 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:06 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 Jul 17 14:30:06 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:07 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:07 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e Jul 17 14:30:07 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:07 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" returned: 0 in 0.422s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:07 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5 Jul 17 14:30:07 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:07 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" returned: 0 in 0.298s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5" released by "delete_volume" :: held 0.772s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Created reservations ['d050dd67-7004-4957-90ea-8132ee6a05e0', 'b8f13a39-dcfa-43dc-ab9d-e80865c2482c', 'e8dcf84f-577a-4ced-8e74-eb308f89d609', '439d229e-245a-4052-9373-c9e3f37847f2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:07 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:07 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:08 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.647s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:08 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Deleted volume successfully. Jul 17 14:30:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38e1c0fb-4a58-43fc-86ac-64acc2a91060 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-af0697d8-2b6c-4641-8bf5-2b43f4ac94d5-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (4a9da7f1-0859-440e-ae44-8fb5f97b3beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce7800c-d927-40fa-b2fd-ae67256271e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce7800c-d927-40fa-b2fd-ae67256271e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77750670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85ac824-6cf2-47fa-84c5-ec2d3451cfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:09Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f0c46d-7db8-41cd-8496-5041584bd1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f0c46d-7db8-41cd-8496-5041584bd1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe970bb-2e5c-469e-a7c1-f8d2940af27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe970bb-2e5c-469e-a7c1-f8d2940af27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85ac824-6cf2-47fa-84c5-ec2d3451cfb0', 'volume_name': 'volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d485af90-264f-4c9a-84ad-d0e3db3200e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d485af90-264f-4c9a-84ad-d0e3db3200e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cfa3d7-976b-4e28-bab0-bdd1f9a08d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Volume f85ac824-6cf2-47fa-84c5-ec2d3451cfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0', 'volume_size': 1} Jul 17 14:30:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:12 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e" returned: 0 in 5.132s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d9412-61e8-49d4-90e0-75aba5fd8dfa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:12 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:12 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:12 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.556s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:30:12 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Converted 1024.00 MB image at 199.49 MB/s Jul 17 14:30:12 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e is being set with open permissions: ugo+rw Jul 17 14:30:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:12 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e Jul 17 14:30:12 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:13 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e" returned: 0 in 0.234s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" released by "_copy_volume_from_snapshot" :: held 6.879s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-23537a3c-ff5a-4519-9515-a461c145a22e" released by "_create_volume_from_snapshot" :: held 6.912s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.929s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.588s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77750670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85ac824-6cf2-47fa-84c5-ec2d3451cfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:09Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Creating volume f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:13 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=142,cinder:UPDATE=183,cinder:INSERT=51,cinder:DELETE=14 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:30:13 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 1073741824 Jul 17 14:30:13 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=141,cinder:UPDATE=187,cinder:INSERT=38,cinder:DELETE=18 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f13e89b-9e23-4e3c-98eb-2cacd93579dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23537a3c-ff5a-4519-9515-a461c145a22e', 'volume_size': 2, 'snapshot_id': 'ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac495bf-c4e5-47dd-a524-4a68383176d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Volume volume-23537a3c-ff5a-4519-9515-a461c145a22e (23537a3c-ff5a-4519-9515-a461c145a22e): created successfully Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac495bf-c4e5-47dd-a524-4a68383176d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (591ddffd-75bf-4e73-91a5-e81cc3afdf94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c96461b9-bd73-4303-bb8e-9af396a75e8a tempest-VolumesSnapshotTestJSON-1277454658 None] Created volume successfully. Jul 17 14:30:13 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 1073741824" returned: 0 in 0.420s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:13 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 Jul 17 14:30:13 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:13 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" returned: 0 in 0.240s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cfa3d7-976b-4e28-bab0-bdd1f9a08d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db957478-825f-481f-bd4e-c82b9216c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Volume volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 (f85ac824-6cf2-47fa-84c5-ec2d3451cfb0): created successfully Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db957478-825f-481f-bd4e-c82b9216c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (4a9da7f1-0859-440e-ae44-8fb5f97b3beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fc486140-1478-4b0d-b0ce-c25828a8affe tempest-ProjectReaderTests-1812300001 None] Created volume successfully. Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-23537a3c-ff5a-4519-9515-a461c145a22e-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-23537a3c-ff5a-4519-9515-a461c145a22e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d7500-87b9-4b20-9ade-f2cee92ed57b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:14 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e Jul 17 14:30:14 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:14 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e" returned: 0 in 0.390s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:14 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e Jul 17 14:30:14 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-quobyte-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2114674b-5269-4ba3-83b6-138166d882c3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:14 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 Jul 17 14:30:14 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:14 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-23537a3c-ff5a-4519-9515-a461c145a22e" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-23537a3c-ff5a-4519-9515-a461c145a22e" released by "delete_volume" :: held 0.694s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['70b739b9-9461-42a5-8f3e-4a0238b916ef', 'dc80cd85-c26d-4b3a-bdb5-5b7058d77f8a', '3bb8dbca-0dec-48b3-8722-fd905374dfd4', '50093bb1-eeba-4438-a5dc-da97654a457d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:15 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:15 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:15 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:15 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0 Jul 17 14:30:15 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:15 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.281s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Deleted volume successfully. Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1016504f-b1ad-4542-b870-789244cb6d2f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-23537a3c-ff5a-4519-9515-a461c145a22e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:15 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" returned: 0 in 0.264s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0" released by "delete_volume" :: held 0.709s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Deleting offline snapshot ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 of volume 6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] snapshot_file for this snap is: volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088f81a-a5e8-4046-9f6f-1d6ce64848f5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Created reservations ['539141ee-2770-47db-b3f2-e794cbc2f985', '9be07cea-4b04-45f6-93c0-0fd5ff583e99', 'f7bb0d44-5563-4eb4-9e82-5c664bf55622', 'f67487f9-82b7-4574-a7af-0ce5e6d5e052'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:15 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:15 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:15 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:15 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:15 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.262s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:15 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.388s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b004c38-77ca-462c-a467-4ff62a8212f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Deleted volume successfully. Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a2627-3373-4f33-8068-a1306be11330]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4b9b3e1d-3da9-4052-94bd-b8b04bc7abf8 tempest-ProjectReaderTests-1812300001 None] Lock "cinder-f85ac824-6cf2-47fa-84c5-ec2d3451cfb0-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:16 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:16 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:16 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.414s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:16 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:16 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (bf1563dc-9442-41ef-8957-ee02a27488dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b374e-9fa8-4705-adb0-1b40fa212c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b374e-9fa8-4705-adb0-1b40fa212c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933687601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa678f6-93ed-43e7-a25a-71819d57b308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:16Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28f4995-50b2-40ce-aaf0-7965f4b7a6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28f4995-50b2-40ce-aaf0-7965f4b7a6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd46dc67-2041-4759-9d76-6504618c4555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd46dc67-2041-4759-9d76-6504618c4555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa678f6-93ed-43e7-a25a-71819d57b308', 'volume_name': 'volume-6aa678f6-93ed-43e7-a25a-71819d57b308', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f1b5da-2ff2-4dcd-8b2b-e56965386f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f1b5da-2ff2-4dcd-8b2b-e56965386f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760cc316-c5b6-4dac-bb73-eaa7603e1ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Volume 6aa678f6-93ed-43e7-a25a-71819d57b308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa678f6-93ed-43e7-a25a-71819d57b308', 'volume_size': 1} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933687601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa678f6-93ed-43e7-a25a-71819d57b308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076b228ce27248c9aa34b817270fa85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:16Z,use_quota=True,user_id='39aef72e52444eac8a5a0110f38e0010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Creating volume 6aa678f6-93ed-43e7-a25a-71819d57b308 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:16 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 1073741824 Jul 17 14:30:16 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:16 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:16 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5 Jul 17 14:30:16 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:16 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:16 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7.ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" returned: 0 in 0.277s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 1073741824" returned: 0 in 0.441s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5" released by "_delete_snapshot" :: held 1.587s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" released by "delete_snapshot" :: held 1.619s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:17 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 Jul 17 14:30:17 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['fcab5745-47cc-4948-9217-ec5ee1cc65f0', '16495e1e-8f0f-4334-a71b-84e43f46a61a', 'a7cb68aa-8561-46f1-b489-4dd00b189573', 'ca6e7ef5-0e05-48fb-8d8b-70206ebf65f3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Delete snapshot completed successfully. Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1430cb19-adae-4d9d-a1bf-0a31400b7eed tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-ae3e2918-d5db-47d8-9abb-3e2fbc48d8b5-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:17 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308" returned: 0 in 0.278s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760cc316-c5b6-4dac-bb73-eaa7603e1ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa678f6-93ed-43e7-a25a-71819d57b308', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a36c575-8f05-48d9-bbed-debe463bb79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Volume volume-6aa678f6-93ed-43e7-a25a-71819d57b308 (6aa678f6-93ed-43e7-a25a-71819d57b308): created successfully Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a36c575-8f05-48d9-bbed-debe463bb79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Flow 'volume_create_manager' (bf1563dc-9442-41ef-8957-ee02a27488dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f4beed43-f914-4a9a-b204-4426615e9abf tempest-ProjectReaderTests-1812300001 None] Created volume successfully. Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-6b004c38-77ca-462c-a467-4ff62a8212f7-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-6b004c38-77ca-462c-a467-4ff62a8212f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab4e77-94d3-4793-bcd5-aba95f56a2c3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:17 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:17 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:18 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:18 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7 Jul 17 14:30:18 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:18 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6b004c38-77ca-462c-a467-4ff62a8212f7" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-6b004c38-77ca-462c-a467-4ff62a8212f7" released by "delete_volume" :: held 0.649s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['bc4c6242-55c2-405f-a3ac-104525f6bba8', '76ee51ee-fe56-4823-b80b-1f54090bc193', 'd2010978-436d-4997-a8fd-67bc6d69baa5', '79416217-0e8d-4277-9b06-779b2e3955c0'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-6aa678f6-93ed-43e7-a25a-71819d57b308-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "cinder-6aa678f6-93ed-43e7-a25a-71819d57b308-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:18 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:18 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Acquiring lock "cinder-quobyte-6aa678f6-93ed-43e7-a25a-71819d57b308" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-6aa678f6-93ed-43e7-a25a-71819d57b308" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe2c475-739e-4de9-886d-fc9dad9e24f6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:18 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 Jul 17 14:30:18 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:18 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.280s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Deleted volume successfully. Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-098e82b2-9656-41aa-ab54-960deac5aa83 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-6b004c38-77ca-462c-a467-4ff62a8212f7-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:18 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:18 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308 Jul 17 14:30:18 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:19 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6aa678f6-93ed-43e7-a25a-71819d57b308" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "cinder-quobyte-6aa678f6-93ed-43e7-a25a-71819d57b308" released by "delete_volume" :: held 0.700s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Created reservations ['3e295e9f-761d-4d58-a35a-ade99ae1e2cd', '6207815e-aaf2-4e1a-a073-1d0073986e24', '8d6ee682-e80b-4abd-a939-6b1e53e7667d', '4f91e5d5-5c26-4d3a-a86d-03ef47ed1987'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (ab94174f-1ceb-4e98-b932-74cfadd3e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6155de-8fb6-4c27-8b8b-be970a421d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6155de-8fb6-4c27-8b8b-be970a421d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438179698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3bef2c-1693-4850-a6ba-58aed2de701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:19Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dc78e1-39c2-486d-9b1c-e250abb536fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dc78e1-39c2-486d-9b1c-e250abb536fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd35db-64fe-4247-8b77-dbb40465efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd35db-64fe-4247-8b77-dbb40465efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3bef2c-1693-4850-a6ba-58aed2de701d', 'volume_name': 'volume-0f3bef2c-1693-4850-a6ba-58aed2de701d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9aeb53a-32cc-473d-8a08-223fe6b225f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9aeb53a-32cc-473d-8a08-223fe6b225f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c382a89f-b17a-4dca-8c1d-85c4be4c251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:19 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume 0f3bef2c-1693-4850-a6ba-58aed2de701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3bef2c-1693-4850-a6ba-58aed2de701d', 'volume_size': 1} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438179698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3bef2c-1693-4850-a6ba-58aed2de701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:19Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Creating volume 0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:19 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:19 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d 1073741824 Jul 17 14:30:19 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:19 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:19 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:19 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.255s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Deleted volume successfully. Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b08690fa-b472-416c-8ac0-e0d9329cf9dd tempest-ProjectReaderTests-1812300001 None] Lock "cinder-6aa678f6-93ed-43e7-a25a-71819d57b308-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:19 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d 1073741824" returned: 0 in 0.501s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:19 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:19 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:20 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.285s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c382a89f-b17a-4dca-8c1d-85c4be4c251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3bef2c-1693-4850-a6ba-58aed2de701d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37396629-b44e-4b91-a4d7-69382a9535af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Volume volume-0f3bef2c-1693-4850-a6ba-58aed2de701d (0f3bef2c-1693-4850-a6ba-58aed2de701d): created successfully Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37396629-b44e-4b91-a4d7-69382a9535af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (ab94174f-1ceb-4e98-b932-74cfadd3e298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d8223920-3263-4ee9-acf6-c63634a85ac6 tempest-VolumesSnapshotTestJSON-1277454658 None] Created volume successfully. Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Creating offline snapshot 4551f5e9-26b5-490f-9a68-1d7ae9de5c7d of volume 0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d413b13-5b55-4e77-81eb-aa0791dd23b6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:21 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:21 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:21 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.340s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:21 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d 1G Jul 17 14:30:21 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:22 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d 1G" returned: 0 in 0.387s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3bef2c-1693-4850-a6ba-58aed2de701d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:22 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3bef2c-1693-4850-a6ba-58aed2de701d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:22 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:22 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3bef2c-1693-4850-a6ba-58aed2de701d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:22 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d is being set with open permissions: ugo+rw Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:22 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:22 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:22 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:22 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info Jul 17 14:30:22 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:23 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info" returned: 0 in 0.244s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:23 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info is being set with open permissions: ugo+rw Jul 17 14:30:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:23 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info Jul 17 14:30:23 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:23 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.info" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:23 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-db0a2fbb-4574-47e1-9bd2-9af538b4ea76 tempest-VolumesSnapshotTestJSON-1277454658 None] Create snapshot completed successfully Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (e1a328c0-bf87-4702-bb01-000da4ccc441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35deab61-e7be-4cbe-9a6e-7861e36df7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35deab61-e7be-4cbe-9a6e-7861e36df7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-718318676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b743c1-82b9-4978-b7c3-54c167442ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacd136169724a24895833eb01cea9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4551f5e9-26b5-490f-9a68-1d7ae9de5c7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:24Z,use_quota=True,user_id='1e4def7db86845e48838784b8635933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a8b11e-39d5-4f8c-b723-1455b341b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a8b11e-39d5-4f8c-b723-1455b341b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de91285a-5f6b-4c33-8d0f-7ea717374493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de91285a-5f6b-4c33-8d0f-7ea717374493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06b743c1-82b9-4978-b7c3-54c167442ee7', 'volume_name': 'volume-06b743c1-82b9-4978-b7c3-54c167442ee7', 'volume_size': 1, 'snapshot_id': '4551f5e9-26b5-490f-9a68-1d7ae9de5c7d'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5583db-40db-4821-ae9f-076bad2d5818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5583db-40db-4821-ae9f-076bad2d5818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db74a7e-be20-4962-a2cd-9698e4057685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:24 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Volume 06b743c1-82b9-4978-b7c3-54c167442ee7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06b743c1-82b9-4978-b7c3-54c167442ee7', 'volume_size': 1, 'snapshot_id': '4551f5e9-26b5-490f-9a68-1d7ae9de5c7d'} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-06b743c1-82b9-4978-b7c3-54c167442ee7" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-06b743c1-82b9-4978-b7c3-54c167442ee7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Creating volume 06b743c1-82b9-4978-b7c3-54c167442ee7 from snapshot 4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] snapshot: 4551f5e9-26b5-490f-9a68-1d7ae9de5c7d, volume: 06b743c1-82b9-4978-b7c3-54c167442ee7, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b6d5c-4033-41d3-b2b6-79d7c39e1ed6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:24 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:24 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:24 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3bef2c-1693-4850-a6ba-58aed2de701d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd778bdf-4ba9-4738-b00b-2b0f2063dcdf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:24 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:24 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:25 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:25 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 Jul 17 14:30:25 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:25 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:25 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:26 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.503s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:30:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:30:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:30:29 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7" returned: 0 in 4.027s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[17729dba-913d-4a80-a0c2-b135d64e379b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:29 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:29 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:29 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.577s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:30:29 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Converted 1024.00 MB image at 254.19 MB/s Jul 17 14:30:29 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 is being set with open permissions: ugo+rw Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:29 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 Jul 17 14:30:29 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:29 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7" returned: 0 in 0.263s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" released by "_copy_volume_from_snapshot" :: held 5.687s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-06b743c1-82b9-4978-b7c3-54c167442ee7" released by "_create_volume_from_snapshot" :: held 5.716s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.732s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db74a7e-be20-4962-a2cd-9698e4057685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b743c1-82b9-4978-b7c3-54c167442ee7', 'volume_size': 1, 'snapshot_id': '4551f5e9-26b5-490f-9a68-1d7ae9de5c7d'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf53648-374f-43c3-b7be-c4855f959495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:30 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Volume volume-06b743c1-82b9-4978-b7c3-54c167442ee7 (06b743c1-82b9-4978-b7c3-54c167442ee7): created successfully Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf53648-374f-43c3-b7be-c4855f959495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Flow 'volume_create_manager' (e1a328c0-bf87-4702-bb01-000da4ccc441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-616aa90a-e2a1-47b0-8713-0e1b50c7b9ef tempest-VolumesSnapshotTestJSON-1277454658 None] Created volume successfully. Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-06b743c1-82b9-4978-b7c3-54c167442ee7-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-06b743c1-82b9-4978-b7c3-54c167442ee7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[287644cc-5dc2-49f4-a851-e476afa49eae]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:31 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 Jul 17 14:30:31 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:31 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:31 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7 Jul 17 14:30:31 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:31 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-06b743c1-82b9-4978-b7c3-54c167442ee7" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-06b743c1-82b9-4978-b7c3-54c167442ee7" released by "delete_volume" :: held 0.670s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['065e44f9-e598-4f3d-ab46-ee36e812028f', '3ce01e52-16ff-4425-acea-a6c820b27f86', 'eeaecb6e-3935-471a-926a-c302c5b2740a', '5ac9bf9d-3d36-486d-a683-7c8938ddad96'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:31 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:31 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:31 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.238s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:31 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Deleted volume successfully. Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-1cd8d29f-73e1-4ae0-810d-6a85ac6cae21 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-06b743c1-82b9-4978-b7c3-54c167442ee7-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Deleting offline snapshot 4551f5e9-26b5-490f-9a68-1d7ae9de5c7d of volume 0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] snapshot_file for this snap is: volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845b990-c9c7-47af-95ac-a6184010c8e4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:32 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:32 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:32 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3bef2c-1693-4850-a6ba-58aed2de701d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e9a44e-6c67-477f-9bb2-752696ac56ed]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:32 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:32 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:32 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.372s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:32 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:32 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:33 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.321s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:33 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d Jul 17 14:30:33 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:33 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d.4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" returned: 0 in 0.255s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d" released by "_delete_snapshot" :: held 1.411s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" released by "delete_snapshot" :: held 1.432s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['5c0481d0-cc57-4fdb-afde-774a8d87ef65', 'fd311938-7b4f-4820-9223-cb03ac481612', 'ac94950b-d70e-4f6a-aa16-cabf1ce57a05', 'f8fd562b-30e5-49b5-b937-c592c97763c5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Delete snapshot completed successfully. Jul 17 14:30:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f7aee766-55f0-49b0-838d-65aa9aeec2b7 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-4551f5e9-26b5-490f-9a68-1d7ae9de5c7d-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-0f3bef2c-1693-4850-a6ba-58aed2de701d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-0f3bef2c-1693-4850-a6ba-58aed2de701d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a8d18-3581-49a7-9620-de2d70354002]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:34 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:34 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:34 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:34 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d Jul 17 14:30:34 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:35 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0f3bef2c-1693-4850-a6ba-58aed2de701d" returned: 0 in 0.244s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-0f3bef2c-1693-4850-a6ba-58aed2de701d" released by "delete_volume" :: held 0.675s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['6f43f872-3ada-4a9b-a6df-91a7ab1e9814', '4cae05e5-a696-4294-9f23-06a1f9bc48bc', 'b7ed13b7-e50e-43af-af01-28054cd9501c', 'dd181352-6d9f-4850-acfa-c3c963b1b490'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:35 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:35 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:35 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Deleted volume successfully. Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6b269384-926b-41d5-a8b3-c15035ff761f tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-0f3bef2c-1693-4850-a6ba-58aed2de701d-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-01077773-f381-4b9c-b7d7-e8482960b8e9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-01077773-f381-4b9c-b7d7-e8482960b8e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a78bf-69b2-4fed-b2b7-a5d31ef1c1fe]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:35 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 Jul 17 14:30:35 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:36 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9" returned: 0 in 0.363s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:36 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9 Jul 17 14:30:36 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:36 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-01077773-f381-4b9c-b7d7-e8482960b8e9" returned: 0 in 0.250s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-quobyte-01077773-f381-4b9c-b7d7-e8482960b8e9" released by "delete_volume" :: held 0.672s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Created reservations ['5a3eaba7-3805-4079-a585-572abbf6822b', 'f3203833-d9a5-4325-87d5-78c656a9ac31', '33c4e99e-adf5-4b5c-bcaa-686ecf49ae82', '51f841f5-53eb-42e0-9713-08e0dbb72a34'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:36 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:36 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:36 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.263s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Deleted volume successfully. Jul 17 14:30:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-35c7d48b-094f-401a-a694-f549eaea0746 tempest-VolumesSnapshotTestJSON-1277454658 None] Lock "cinder-01077773-f381-4b9c-b7d7-e8482960b8e9-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Flow 'volume_create_manager' (13214e12-5d12-4ba4-9343-c29f7efb7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14256134-811b-4ca3-9550-bfe74e97e35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14256134-811b-4ca3-9550-bfe74e97e35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1048904690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b9766e-ff3b-4c9d-aa4b-e93de496b9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5beb16db1ea04ffc8c89114c95542a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:42Z,use_quota=True,user_id='10df7511b2e04064a5c9d82ffd6afe11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe70ed6-3676-498d-b33d-f60187edf7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe70ed6-3676-498d-b33d-f60187edf7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43725acd-4af1-4cf2-82e4-5791f97e851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43725acd-4af1-4cf2-82e4-5791f97e851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b9766e-ff3b-4c9d-aa4b-e93de496b9b7', 'volume_name': 'volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586ee420-e505-4891-8cd2-85e7e157e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586ee420-e505-4891-8cd2-85e7e157e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94349708-f242-412f-8fe5-4b82b7ea2561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:42 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7', 'volume_size': 1} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1048904690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b9766e-ff3b-4c9d-aa4b-e93de496b9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5beb16db1ea04ffc8c89114c95542a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:30:42Z,use_quota=True,user_id='10df7511b2e04064a5c9d82ffd6afe11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Creating volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:30:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:42 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 1073741824 Jul 17 14:30:42 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:42 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 1073741824" returned: 0 in 0.411s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:43 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 Jul 17 14:30:43 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:43 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" returned: 0 in 0.238s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94349708-f242-412f-8fe5-4b82b7ea2561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74f178-451f-4272-87ad-2b521ef9231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:30:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Volume volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 (60b9766e-ff3b-4c9d-aa4b-e93de496b9b7): created successfully Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74f178-451f-4272-87ad-2b521ef9231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Flow 'volume_create_manager' (13214e12-5d12-4ba4-9343-c29f7efb7c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:30:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b18664fe-9503-48a6-ae5d-22bb41326da5 tempest-VolumesSnapshotListTestJSON-1774522951 None] Created volume successfully. Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Creating offline snapshot 95e00656-14c0-4ab4-95a8-30671df9ca69 of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c480f9-3d28-4846-82f2-b38b9f7eff50]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:43 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 Jul 17 14:30:43 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:44 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:44 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 1G Jul 17 14:30:44 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:44 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 1G" returned: 0 in 0.365s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:44 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:44 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:44 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.262s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:44 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 is being set with open permissions: ugo+rw Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:44 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:44 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:44 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.227s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:44 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info Jul 17 14:30:45 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:45 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info" returned: 0 in 0.239s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:45 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info is being set with open permissions: ugo+rw Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:45 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info Jul 17 14:30:45 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:45 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.info" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ec4815b0-435e-41a4-b207-3d340aece988 tempest-VolumesSnapshotListTestJSON-1774522951 None] Create snapshot completed successfully Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Creating offline snapshot 4137fe73-f0c7-4469-bbb1-52ac2a83c851 of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7adac-e543-4df1-b1ae-3af489ba5fbf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:46 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:46 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:46 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:46 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 1G Jul 17 14:30:46 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:46 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 1G" returned: 0 in 0.413s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:46 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:46 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:47 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.270s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:47 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 is being set with open permissions: ugo+rw Jul 17 14:30:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:47 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:47 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:47 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.227s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.332s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:47 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c0bbb31c-508e-4b14-8c08-736b1fb43b16 tempest-VolumesSnapshotListTestJSON-1774522951 None] Create snapshot completed successfully Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Creating offline snapshot b12c4000-5a13-4858-a65b-d3304e1f11ec of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbb0a4-aca7-459a-a988-c902ab303747]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:48 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:48 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:48 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:48 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec 1G Jul 17 14:30:48 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:49 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec 1G" returned: 0 in 0.420s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:49 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec Jul 17 14:30:49 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:49 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec" returned: 0 in 0.275s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:49 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec is being set with open permissions: ugo+rw Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:49 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec Jul 17 14:30:49 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:49 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec" returned: 0 in 0.240s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.364s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-93f40662-8b85-4007-bbad-7a7b5f3fdf94 tempest-VolumesSnapshotListTestJSON-1774522951 None] Create snapshot completed successfully Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-b12c4000-5a13-4858-a65b-d3304e1f11ec-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-b12c4000-5a13-4858-a65b-d3304e1f11ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-b12c4000-5a13-4858-a65b-d3304e1f11ec" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-b12c4000-5a13-4858-a65b-d3304e1f11ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Deleting offline snapshot b12c4000-5a13-4858-a65b-d3304e1f11ec of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] snapshot_file for this snap is: volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3ffd7-266e-4efb-91df-4670663d42f6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:51 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec Jul 17 14:30:51 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:51 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec" returned: 0 in 0.350s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fffd8e-6e9f-454e-98bf-50cbabc277fd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:51 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:51 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:51 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:51 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec Jul 17 14:30:51 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:52 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec" returned: 0 in 0.393s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:52 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec Jul 17 14:30:52 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:52 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.b12c4000-5a13-4858-a65b-d3304e1f11ec" returned: 0 in 0.249s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-b12c4000-5a13-4858-a65b-d3304e1f11ec" released by "_delete_snapshot" :: held 1.421s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" released by "delete_snapshot" :: held 1.442s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Created reservations ['77ec4933-191b-4db1-bf63-2c37d28c7530', '99f9d6b8-bb49-4a3e-b5b2-800e308714b5', 'eab5c298-1a71-44f2-8a93-2a4cf74b75e3', '6a0b8c29-a94a-41ef-8d89-ca202abc5ebc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Delete snapshot completed successfully. Jul 17 14:30:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-408cfc0e-3229-4710-8571-9e0a7bb1580c tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-b12c4000-5a13-4858-a65b-d3304e1f11ec-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-4137fe73-f0c7-4469-bbb1-52ac2a83c851-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-4137fe73-f0c7-4469-bbb1-52ac2a83c851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-4137fe73-f0c7-4469-bbb1-52ac2a83c851" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-4137fe73-f0c7-4469-bbb1-52ac2a83c851" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Deleting offline snapshot 4137fe73-f0c7-4469-bbb1-52ac2a83c851 of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] snapshot_file for this snap is: volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ed0a5-b365-4d11-afd5-aa2b35b5f830]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:53 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:53 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:53 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.349s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d63dbb-8ec0-4741-9051-c5686dc34978]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:53 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:53 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:53 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.359s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:54 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:54 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:54 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:54 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851 Jul 17 14:30:54 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:54 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.4137fe73-f0c7-4469-bbb1-52ac2a83c851" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-4137fe73-f0c7-4469-bbb1-52ac2a83c851" released by "_delete_snapshot" :: held 1.406s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" released by "delete_snapshot" :: held 1.430s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Created reservations ['6f5c2656-e809-4e69-bfa4-723651034e58', '271b75bd-3196-41e1-9a58-ab77bec4a2cf', 'e0110be6-8511-4825-9ab9-404d167b9575', '78d5f749-e5b3-4708-bdbb-eb359d0aa8c5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Delete snapshot completed successfully. Jul 17 14:30:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-78557cee-7ac9-4a60-9c33-d5a57282ec15 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-4137fe73-f0c7-4469-bbb1-52ac2a83c851-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-95e00656-14c0-4ab4-95a8-30671df9ca69-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-95e00656-14c0-4ab4-95a8-30671df9ca69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-95e00656-14c0-4ab4-95a8-30671df9ca69" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-95e00656-14c0-4ab4-95a8-30671df9ca69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Deleting offline snapshot 95e00656-14c0-4ab4-95a8-30671df9ca69 of volume 60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] snapshot_file for this snap is: volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa50c0-86c5-4444-912d-2cb18f8cc4ae]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:55 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:55 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:55 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dee541-d208-4c50-b41b-7b071494332f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:55 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 Jul 17 14:30:55 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:56 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:56 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:56 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:56 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.323s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:56 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69 Jul 17 14:30:56 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:56 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7.95e00656-14c0-4ab4-95a8-30671df9ca69" returned: 0 in 0.232s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-95e00656-14c0-4ab4-95a8-30671df9ca69" released by "_delete_snapshot" :: held 1.365s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" released by "delete_snapshot" :: held 1.390s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Created reservations ['4765ccc2-e1e5-40b6-9b65-4d47ed67f31f', 'fa00779f-f577-4e5c-9731-cb6a872e16e8', '15509276-70fd-4a89-b4dd-d28e50e508a1', '955055fa-b174-4822-8f26-67ec8bcf23de'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Delete snapshot completed successfully. Jul 17 14:30:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-229bb0d9-ac6b-402d-97e6-e6d5ee3cc1de tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-95e00656-14c0-4ab4-95a8-30671df9ca69-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" acquired by "delete_volume" :: waited 0.012s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c61c7-35c6-4efc-b11e-0dd6a68a6089]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:30:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:57 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 Jul 17 14:30:57 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:58 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:58 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7 Jul 17 14:30:58 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:58 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-quobyte-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7" released by "delete_volume" :: held 0.634s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Created reservations ['d917bb17-ebff-407f-ad6d-203885fa487b', 'e3a27af9-8cea-42ef-b601-5948cce824de', '7266f49d-f0ee-442f-a285-7bf48feb7637', 'addd04e0-0c3e-4f2c-b8e2-9c3d9736c1ca'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:30:58 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:30:58 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:30:58 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.286s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:30:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Deleted volume successfully. Jul 17 14:30:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-41439d4c-66ab-408e-abea-24d9809affe7 tempest-VolumesSnapshotListTestJSON-1774522951 None] Lock "cinder-60b9766e-ff3b-4c9d-aa4b-e93de496b9b7-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Flow 'volume_create_manager' (08b3a8e1-a7a1-4700-8e1f-e10c6df551f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a033559e-1f6b-4c2e-8c5e-d9b164ee835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a033559e-1f6b-4c2e-8c5e-d9b164ee835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2057401550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f17906a-0e7a-46f5-ab16-14236502567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca4c21a162f44bcb35e796f9d6bad76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:31:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:31:02Z,use_quota=True,user_id='fa2bc68cd27c4948b70dc01b0002beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c063d0fa-4a18-4df9-88f6-b3678c70acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c063d0fa-4a18-4df9-88f6-b3678c70acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc6f799-3cdb-44e0-adf2-af8141745bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc6f799-3cdb-44e0-adf2-af8141745bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f17906a-0e7a-46f5-ab16-14236502567e', 'volume_name': 'volume-2f17906a-0e7a-46f5-ab16-14236502567e', 'volume_size': 2}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca08f43-0370-4757-8a6e-19c8abc75cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca08f43-0370-4757-8a6e-19c8abc75cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a7b62-5bc0-4886-9956-7a0f0c65ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Volume 2f17906a-0e7a-46f5-ab16-14236502567e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f17906a-0e7a-46f5-ab16-14236502567e', 'volume_size': 2} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2057401550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f17906a-0e7a-46f5-ab16-14236502567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca4c21a162f44bcb35e796f9d6bad76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:31:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:31:02Z,use_quota=True,user_id='fa2bc68cd27c4948b70dc01b0002beda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Creating volume 2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:31:01 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:31:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e 2147483648 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:01 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e 2147483648 Jul 17 14:31:01 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:02 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e 2147483648" returned: 0 in 0.513s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:02 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e Jul 17 14:31:02 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:02 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e" returned: 0 in 0.261s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a7b62-5bc0-4886-9956-7a0f0c65ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f17906a-0e7a-46f5-ab16-14236502567e', 'volume_size': 2}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398a270b-40e5-4ce8-9983-978532b56735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:31:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Volume volume-2f17906a-0e7a-46f5-ab16-14236502567e (2f17906a-0e7a-46f5-ab16-14236502567e): created successfully Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398a270b-40e5-4ce8-9983-978532b56735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:31:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Flow 'volume_create_manager' (08b3a8e1-a7a1-4700-8e1f-e10c6df551f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:31:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a024c499-be53-4959-9a44-6008fb89ed36 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Created volume successfully. Jul 17 14:31:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:31:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:31:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Creating offline snapshot 489a9816-e063-4081-b57e-272579b1aeb7 of volume 2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:31:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002e344-0f69-47ea-a2e2-f6b725437f7f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:31:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:04 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e Jul 17 14:31:04 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:04 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 2G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:04 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 2G Jul 17 14:31:04 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:04 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 2G" returned: 0 in 0.401s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f17906a-0e7a-46f5-ab16-14236502567e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:04 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f17906a-0e7a-46f5-ab16-14236502567e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 Jul 17 14:31:04 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:05 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f17906a-0e7a-46f5-ab16-14236502567e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:05 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 is being set with open permissions: ugo+rw Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:05 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 Jul 17 14:31:05 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:05 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:05 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info Jul 17 14:31:05 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:05 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:05 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info is being set with open permissions: ugo+rw Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:05 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info Jul 17 14:31:05 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:05 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.info" returned: 0 in 0.268s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:31:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1253af09-2cd2-4fa1-8149-e1f8d7f869ef tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Create snapshot completed successfully Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "cinder-489a9816-e063-4081-b57e-272579b1aeb7-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-489a9816-e063-4081-b57e-272579b1aeb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "cinder-quobyte-489a9816-e063-4081-b57e-272579b1aeb7" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-489a9816-e063-4081-b57e-272579b1aeb7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Deleting offline snapshot 489a9816-e063-4081-b57e-272579b1aeb7 of volume 2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] snapshot_file for this snap is: volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c36b5c-e1ba-4d5f-8a8f-ebbf1f6e9996]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:06 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 Jul 17 14:31:06 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:06 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f17906a-0e7a-46f5-ab16-14236502567e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272dd18-0cc0-42bf-b068-147c94c7713f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:06 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e Jul 17 14:31:06 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:06 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:06 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 Jul 17 14:31:06 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:07 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7" returned: 0 in 0.328s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:07 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7 Jul 17 14:31:07 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:07 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e.489a9816-e063-4081-b57e-272579b1aeb7" returned: 0 in 0.248s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-489a9816-e063-4081-b57e-272579b1aeb7" released by "_delete_snapshot" :: held 1.415s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" released by "delete_snapshot" :: held 1.440s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Created reservations ['b62d67d0-0bd9-4ec1-a650-66c328944b84', 'c7e53262-ab2c-4b03-8960-50db438fec68', '0b38dd06-9a3f-45cb-904d-5d7ed58a44d8', 'a9bdc7c0-7863-4b8b-9861-2f5d694a5707'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:31:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Delete snapshot completed successfully. Jul 17 14:31:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7a07c94b-b776-4001-9cb9-f8731784f220 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-489a9816-e063-4081-b57e-272579b1aeb7-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "cinder-2f17906a-0e7a-46f5-ab16-14236502567e-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-2f17906a-0e7a-46f5-ab16-14236502567e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5cd52f-b8a4-41a2-aa50-54f09d41bd6d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:08 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e Jul 17 14:31:08 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:08 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:08 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e Jul 17 14:31:08 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:09 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2f17906a-0e7a-46f5-ab16-14236502567e" returned: 0 in 0.249s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-quobyte-2f17906a-0e7a-46f5-ab16-14236502567e" released by "delete_volume" :: held 0.667s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Created reservations ['4508ceda-6472-4110-9847-4990c341cf46', 'c7486e72-0315-4c0e-af08-d058001abc61', '360d2db0-ece1-455f-a740-c24f344e68f7', '2ea25e00-3b4d-4c84-a172-e29f8e61702d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:09 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:31:09 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:09 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.260s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:31:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Deleted volume successfully. Jul 17 14:31:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-bc6ecb24-5004-4edd-a535-d3425ceb7689 tempest-VolumesSnapshotNegativeTestJSON-1154699148 None] Lock "cinder-2f17906a-0e7a-46f5-ab16-14236502567e-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:31:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=134,cinder:DELETE=12,cinder:SELECT=104,cinder:INSERT=30 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:31:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=103,cinder:UPDATE=125,cinder:INSERT=38,cinder:DELETE=9 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:31:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:31:25 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:31:25 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:31:26 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 17 14:31:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:31:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:31:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:31:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:31:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Flow 'volume_create_manager' (0b3913f1-cf88-41da-b870-70a15e755aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8c0884-0592-4ed5-bbeb-e2eeceb1f8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8c0884-0592-4ed5-bbeb-e2eeceb1f8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1395732512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9fbb32-bade-409c-a941-18ce68247a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b0283fee624667afe2ea3b2e623cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:01Z,use_quota=True,user_id='bdad523b302e4041ae6218dd242abeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c6517a-5c92-43ec-9761-98268d11556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c6517a-5c92-43ec-9761-98268d11556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884daf8-afcd-45ba-97ac-3bb53df6e79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884daf8-afcd-45ba-97ac-3bb53df6e79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9fbb32-bade-409c-a941-18ce68247a40', 'volume_name': 'volume-0a9fbb32-bade-409c-a941-18ce68247a40', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f28684-d07b-4765-a13e-02d6abe94caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f28684-d07b-4765-a13e-02d6abe94caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d340c9ba-73bd-4360-8119-f09d4cd39f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Volume 0a9fbb32-bade-409c-a941-18ce68247a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9fbb32-bade-409c-a941-18ce68247a40', 'volume_size': 1} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1395732512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9fbb32-bade-409c-a941-18ce68247a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b0283fee624667afe2ea3b2e623cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:01Z,use_quota=True,user_id='bdad523b302e4041ae6218dd242abeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Creating volume 0a9fbb32-bade-409c-a941-18ce68247a40 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:01 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:01 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 1073741824 Jul 17 14:32:01 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:02 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 1073741824" returned: 0 in 0.509s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:02 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 Jul 17 14:32:02 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:02 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d340c9ba-73bd-4360-8119-f09d4cd39f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9fbb32-bade-409c-a941-18ce68247a40', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f43af9-c43d-4276-a33c-4980dfc4fcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Volume volume-0a9fbb32-bade-409c-a941-18ce68247a40 (0a9fbb32-bade-409c-a941-18ce68247a40): created successfully Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f43af9-c43d-4276-a33c-4980dfc4fcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Flow 'volume_create_manager' (0b3913f1-cf88-41da-b870-70a15e755aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cd45bbc0-7787-4626-bb9b-e78e23871f98 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Created volume successfully. Jul 17 14:32:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-726ff5b3-7d82-4132-a146-21f28c90db79 req-fc74b972-b9e4-4c01-ad6e-9a993c80f39b tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-726ff5b3-7d82-4132-a146-21f28c90db79 req-fc74b972-b9e4-4c01-ad6e-9a993c80f39b tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [req-726ff5b3-7d82-4132-a146-21f28c90db79 req-fc74b972-b9e4-4c01-ad6e-9a993c80f39b tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-726ff5b3-7d82-4132-a146-21f28c90db79 req-fc74b972-b9e4-4c01-ad6e-9a993c80f39b tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803', 'name': 'volume-0a9fbb32-bade-409c-a941-18ce68247a40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d24867d-e0fd-427a-aeac-a1e4d6317166', 'enforce_multipath': True} {{(pid=87804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 14:32:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-726ff5b3-7d82-4132-a146-21f28c90db79 req-fc74b972-b9e4-4c01-ad6e-9a993c80f39b tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] attachment_update completed successfully. Jul 17 14:32:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [req-fd641250-cfb3-4791-9695-5d0dc87f3480 req-dae10509-614d-4b20-87cb-c02b1ba233f1 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Terminate volume connection completed successfully. Jul 17 14:32:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [req-fd641250-cfb3-4791-9695-5d0dc87f3480 req-dae10509-614d-4b20-87cb-c02b1ba233f1 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Deleting attachment 7d24867d-e0fd-427a-aeac-a1e4d6317166. {{(pid=87804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "cinder-0a9fbb32-bade-409c-a941-18ce68247a40-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "cinder-0a9fbb32-bade-409c-a941-18ce68247a40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "cinder-quobyte-0a9fbb32-bade-409c-a941-18ce68247a40" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "cinder-quobyte-0a9fbb32-bade-409c-a941-18ce68247a40" acquired by "delete_volume" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d8b4e-8a1f-4fb6-9780-072727ba4905]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:07 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 Jul 17 14:32:07 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:07 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:07 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40 Jul 17 14:32:07 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:07 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0a9fbb32-bade-409c-a941-18ce68247a40" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "cinder-quobyte-0a9fbb32-bade-409c-a941-18ce68247a40" released by "delete_volume" :: held 0.632s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Created reservations ['95963a0f-ea5d-4ebb-84fb-34fd8731b8c3', '6896e8fa-0226-42ec-b3c7-4099218d1c7e', '16c7a73b-e3c7-452a-984b-3ecea19c7b34', 'a9d03028-bfa3-4493-8655-2f6f83caa11c'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:07 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:07 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:08 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.232s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:08 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Deleted volume successfully. Jul 17 14:32:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdbdb2f-6e08-457f-84a6-b283aaa45800 tempest-TestServerVolumeAttachScenarioOldVersion-1472738577 None] Lock "cinder-0a9fbb32-bade-409c-a941-18ce68247a40-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:17 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:32:18 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (dbf5552f-a74d-4b61-829e-38bc0182fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ac5343-fada-43b5-ae3e-be9ae2505633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ac5343-fada-43b5-ae3e-be9ae2505633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005583928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb70516b-d34b-4323-8998-781188ea5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:22Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0c2c1-e220-47d3-adc3-014ec10ddbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0c2c1-e220-47d3-adc3-014ec10ddbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f43d95-f2b3-442c-8263-9f20bb46ee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f43d95-f2b3-442c-8263-9f20bb46ee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb70516b-d34b-4323-8998-781188ea5ec2', 'volume_name': 'volume-fb70516b-d34b-4323-8998-781188ea5ec2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbf404-fde2-4182-aa34-13debb75cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dbf404-fde2-4182-aa34-13debb75cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c4dbb3-7b6a-452d-bfbd-ee19ea5872d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume fb70516b-d34b-4323-8998-781188ea5ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb70516b-d34b-4323-8998-781188ea5ec2', 'volume_size': 1} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005583928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb70516b-d34b-4323-8998-781188ea5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:22Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:22 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:22 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 1073741824 Jul 17 14:32:22 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:22 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 1073741824" returned: 0 in 0.442s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:22 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 Jul 17 14:32:22 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:22 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2" returned: 0 in 0.254s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c4dbb3-7b6a-452d-bfbd-ee19ea5872d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb70516b-d34b-4323-8998-781188ea5ec2', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61110ab4-da0c-4bbb-ba55-476a5e7221d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:22 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-fb70516b-d34b-4323-8998-781188ea5ec2 (fb70516b-d34b-4323-8998-781188ea5ec2): created successfully Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61110ab4-da0c-4bbb-ba55-476a5e7221d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (dbf5552f-a74d-4b61-829e-38bc0182fd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-29661d67-d695-4f40-983e-8c21e12e2228 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating offline snapshot 35848a89-0797-4c33-ad0a-2294efeeb006 of volume fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6952be-5944-4907-9385-6a4d27d3c48d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:23 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 Jul 17 14:32:23 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:23 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:23 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 1G Jul 17 14:32:23 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:24 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 1G" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb70516b-d34b-4323-8998-781188ea5ec2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:24 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb70516b-d34b-4323-8998-781188ea5ec2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 Jul 17 14:32:24 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:24 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb70516b-d34b-4323-8998-781188ea5ec2 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006" returned: 0 in 0.300s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:24 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 is being set with open permissions: ugo+rw Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:24 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 Jul 17 14:32:24 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:24 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006" returned: 0 in 0.281s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:24 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info Jul 17 14:32:24 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:24 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info" returned: 0 in 0.261s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:24 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info is being set with open permissions: ugo+rw Jul 17 14:32:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:24 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info Jul 17 14:32:24 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:25 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.info" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-22a84b2d-1483-40be-8041-55f30d210d89 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Create snapshot completed successfully Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (2e83428f-ed0b-44af-86a4-cbb38e10b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e90571-6b76-468e-98ec-308302295200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e90571-6b76-468e-98ec-308302295200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147730174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4deb2-ae79-4081-9b89-047f7e222623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:26Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86537aab-52a9-4396-8b2a-2cf9bf4e9f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86537aab-52a9-4396-8b2a-2cf9bf4e9f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4db75a5-6835-4425-804e-ff4464f05352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4db75a5-6835-4425-804e-ff4464f05352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc4deb2-ae79-4081-9b89-047f7e222623', 'volume_name': 'volume-dfc4deb2-ae79-4081-9b89-047f7e222623', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec3961a-2a41-4e59-be26-a3b4a384035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec3961a-2a41-4e59-be26-a3b4a384035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1bd4f9-0860-4b07-af25-09ffe415d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:25 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume dfc4deb2-ae79-4081-9b89-047f7e222623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc4deb2-ae79-4081-9b89-047f7e222623', 'volume_size': 1} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147730174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4deb2-ae79-4081-9b89-047f7e222623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:26Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume dfc4deb2-ae79-4081-9b89-047f7e222623 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:25 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:25 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 1073741824 Jul 17 14:32:25 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (892d561c-6729-430a-a784-79c10a8ba23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6755c198-7daa-4447-a1d7-364e3d20a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6755c198-7daa-4447-a1d7-364e3d20a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820907116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572ac3c0-3685-4a92-bbab-af819119146f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:26Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cb22e8-5652-4a0f-95c7-3e5206530e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cb22e8-5652-4a0f-95c7-3e5206530e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340f286e-68b2-4970-952a-105b3b2462cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340f286e-68b2-4970-952a-105b3b2462cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572ac3c0-3685-4a92-bbab-af819119146f', 'volume_name': 'volume-572ac3c0-3685-4a92-bbab-af819119146f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309284bb-5521-408b-8e90-3e0f58bcd105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309284bb-5521-408b-8e90-3e0f58bcd105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ed358f-79a9-421e-bacd-7f7701394f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume 572ac3c0-3685-4a92-bbab-af819119146f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572ac3c0-3685-4a92-bbab-af819119146f', 'volume_size': 1} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:26 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 1073741824" returned: 0 in 0.556s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:26 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 Jul 17 14:32:26 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (2105a70f-f4ef-487d-a7c8-2375c3f315eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f75d4-3085-4aa0-88c0-cfb06f900365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f75d4-3085-4aa0-88c0-cfb06f900365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205141878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b36cbe-8131-42f4-a6b5-21ae6046e63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e735f92-d9fd-4c99-a04c-a3dfac368041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e735f92-d9fd-4c99-a04c-a3dfac368041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b43c2f-7a43-4ef4-83f7-48a1be6d77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b43c2f-7a43-4ef4-83f7-48a1be6d77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b36cbe-8131-42f4-a6b5-21ae6046e63d', 'volume_name': 'volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a20edbd-3efd-4540-ae09-202c4db2dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a20edbd-3efd-4540-ae09-202c4db2dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01059bb-ff44-4cf6-8605-31fec0d83290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume 55b36cbe-8131-42f4-a6b5-21ae6046e63d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d', 'volume_size': 1} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:26 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623" returned: 0 in 0.283s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820907116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572ac3c0-3685-4a92-bbab-af819119146f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:26Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume 572ac3c0-3685-4a92-bbab-af819119146f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:26 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1bd4f9-0860-4b07-af25-09ffe415d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc4deb2-ae79-4081-9b89-047f7e222623', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92307ee6-0fd6-4698-a60a-96f0164d9c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:26 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f 1073741824 Jul 17 14:32:26 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-dfc4deb2-ae79-4081-9b89-047f7e222623 (dfc4deb2-ae79-4081-9b89-047f7e222623): created successfully Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92307ee6-0fd6-4698-a60a-96f0164d9c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (2e83428f-ed0b-44af-86a4-cbb38e10b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6562c40d-4d51-42cd-918d-56bc776ac300 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (5920b399-e31b-4cef-90e4-96c631ff3f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767d2591-8b37-4955-b692-e0389a9bb096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767d2591-8b37-4955-b692-e0389a9bb096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311887206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae10575d-7337-4dba-a112-442259fd8df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5726d7f-b857-4f33-a277-dd448e091e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5726d7f-b857-4f33-a277-dd448e091e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb2dc6b-bd89-436d-981a-1c03615bceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb2dc6b-bd89-436d-981a-1c03615bceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae10575d-7337-4dba-a112-442259fd8df0', 'volume_name': 'volume-ae10575d-7337-4dba-a112-442259fd8df0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29960b6b-a698-4d0d-9eb0-56ef42b7510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29960b6b-a698-4d0d-9eb0-56ef42b7510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c74e14-daa9-4258-8fe6-da04f18ba3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume ae10575d-7337-4dba-a112-442259fd8df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae10575d-7337-4dba-a112-442259fd8df0', 'volume_size': 1} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:27 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (11b97282-41db-409b-a15d-0dfadb287320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8580b03d-520e-4252-a759-f8d2a92c0ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f 1073741824" returned: 0 in 0.569s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8580b03d-520e-4252-a759-f8d2a92c0ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273076028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a83609-dd31-4e1e-9577-093fcad8ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a83609-dd31-4e1e-9577-093fcad8ec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a16e05a-bf3e-4f60-88c6-f2ac5610739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a16e05a-bf3e-4f60-88c6-f2ac5610739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89', 'volume_name': 'volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef96a51-baaf-4c5b-88ff-57702c74f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef96a51-baaf-4c5b-88ff-57702c74f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78be0887-e533-46e8-855f-4bf9f253c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89', 'volume_size': 1} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:27 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f Jul 17 14:32:27 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:27 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f" returned: 0 in 0.244s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205141878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b36cbe-8131-42f4-a6b5-21ae6046e63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume 55b36cbe-8131-42f4-a6b5-21ae6046e63d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:27 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:27 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d 1073741824 Jul 17 14:32:27 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ed358f-79a9-421e-bacd-7f7701394f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572ac3c0-3685-4a92-bbab-af819119146f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a5f9f3-4237-420a-8270-05cdb7373db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-572ac3c0-3685-4a92-bbab-af819119146f (572ac3c0-3685-4a92-bbab-af819119146f): created successfully Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a5f9f3-4237-420a-8270-05cdb7373db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (892d561c-6729-430a-a784-79c10a8ba23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b5274196-06bb-4e1b-99b0-90f06973e61b tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:28 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d 1073741824" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:28 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d Jul 17 14:32:28 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:28 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d" returned: 0 in 0.269s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311887206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae10575d-7337-4dba-a112-442259fd8df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume ae10575d-7337-4dba-a112-442259fd8df0 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01059bb-ff44-4cf6-8605-31fec0d83290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:28 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 1073741824 Jul 17 14:32:28 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92cc1a-9cec-498c-a0bd-8fa98340e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:28 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d (55b36cbe-8131-42f4-a6b5-21ae6046e63d): created successfully Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92cc1a-9cec-498c-a0bd-8fa98340e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (2105a70f-f4ef-487d-a7c8-2375c3f315eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:28 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2ac5421a-3f7b-4106-8008-325583211cc2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:28 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 1073741824" returned: 0 in 0.459s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:28 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 Jul 17 14:32:28 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:29 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273076028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0d909681284b2585c64fcf56a3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:27Z,use_quota=True,user_id='327a8260171b42d9bf1319365ddfdece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Creating volume d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:29 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c74e14-daa9-4258-8fe6-da04f18ba3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae10575d-7337-4dba-a112-442259fd8df0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:29 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 1073741824 Jul 17 14:32:29 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addb99e0-6ddb-48ba-9dda-80235a19e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-ae10575d-7337-4dba-a112-442259fd8df0 (ae10575d-7337-4dba-a112-442259fd8df0): created successfully Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addb99e0-6ddb-48ba-9dda-80235a19e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (5920b399-e31b-4cef-90e4-96c631ff3f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-316b5d14-8d0c-4ebf-8382-248ac45965ff tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:29 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 1073741824" returned: 0 in 0.466s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:29 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 Jul 17 14:32:29 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:29 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" returned: 0 in 0.233s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78be0887-e533-46e8-855f-4bf9f253c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6657f1d0-1de8-44c4-a844-e465d99b3c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Volume volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 (d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89): created successfully Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6657f1d0-1de8-44c4-a844-e465d99b3c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Flow 'volume_create_manager' (11b97282-41db-409b-a15d-0dfadb287320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-46f50163-7eb2-467b-b702-40f2b7954974 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created volume successfully. Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[98445f95-3b43-4260-a893-3f400330a48a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:30 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 Jul 17 14:32:30 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:31 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" returned: 0 in 0.391s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:31 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89 Jul 17 14:32:31 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:31 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" returned: 0 in 0.251s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89" released by "delete_volume" :: held 0.681s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['041e2248-06f0-431b-894a-57f42e32ab6a', 'ec43ef3d-0cb8-4bae-9a80-9c9d41402f94', '57c28267-0e52-4368-85b5-ffccbbb4b825', '4cbe547a-bd0d-41d8-9873-a2715de5da2b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:31 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:31 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:31 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5bef876-1162-4975-8117-057d04bff9df tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-d75206ee-8a3d-4ca0-a22a-a9f9d1fc8f89-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-ae10575d-7337-4dba-a112-442259fd8df0-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-ae10575d-7337-4dba-a112-442259fd8df0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-ae10575d-7337-4dba-a112-442259fd8df0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-ae10575d-7337-4dba-a112-442259fd8df0" acquired by "delete_volume" :: waited 0.012s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204c2e9-bbd0-41b9-8875-ad2c326dda47]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:32 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 Jul 17 14:32:32 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:32 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:32 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0 Jul 17 14:32:32 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:32 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ae10575d-7337-4dba-a112-442259fd8df0" returned: 0 in 0.276s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-ae10575d-7337-4dba-a112-442259fd8df0" released by "delete_volume" :: held 0.670s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['ad32d6c3-5928-4be1-9053-f0dadd3e43e8', '2a662a8c-bd0f-45fb-b44d-d3095ea00a37', 'f0948a4b-a492-4279-94b5-aa477002bc9f', 'e3ec70ba-dcc5-4e55-9956-4c3ec223ae13'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:32 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:32 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:33 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.237s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32a8088d-db06-4bcd-b8c3-a68485556c07 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-ae10575d-7337-4dba-a112-442259fd8df0-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-55b36cbe-8131-42f4-a6b5-21ae6046e63d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-55b36cbe-8131-42f4-a6b5-21ae6046e63d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-55b36cbe-8131-42f4-a6b5-21ae6046e63d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-55b36cbe-8131-42f4-a6b5-21ae6046e63d" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90afe2c-7fa9-4c42-9051-79214fbf316c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:33 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d Jul 17 14:32:33 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:33 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:33 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d Jul 17 14:32:33 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:33 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55b36cbe-8131-42f4-a6b5-21ae6046e63d" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-55b36cbe-8131-42f4-a6b5-21ae6046e63d" released by "delete_volume" :: held 0.658s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['b8b6bd1d-a27c-4638-acaa-fba2e243cc7f', '5bf7d20c-2ce9-4d48-88d8-609aea2e3b1b', '7df117e4-62b4-456b-b6fd-60f3f8627d26', '5299eaa9-d087-46ec-a9b6-062b983f47c3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:33 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:33 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:34 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-64dab2c9-18fa-4557-a52d-827aa9e08cd2 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-55b36cbe-8131-42f4-a6b5-21ae6046e63d-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-572ac3c0-3685-4a92-bbab-af819119146f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-572ac3c0-3685-4a92-bbab-af819119146f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-572ac3c0-3685-4a92-bbab-af819119146f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-572ac3c0-3685-4a92-bbab-af819119146f" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13b41b-019c-4e05-bd2c-cbc8d15e98c9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:34 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f Jul 17 14:32:34 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:34 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:34 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f Jul 17 14:32:34 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:34 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-572ac3c0-3685-4a92-bbab-af819119146f" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-572ac3c0-3685-4a92-bbab-af819119146f" released by "delete_volume" :: held 0.642s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['0b24feb0-c4d2-47e8-9d0b-1f16bce1bce8', '984a2df9-4bfa-4272-9c36-5b10ff8406a1', '34d20684-1584-4909-98e7-5555e9ab056c', '2b5cbdc2-fc80-40f2-bd39-e758b99597e9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:35 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:35 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:35 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.237s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:35 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c9014e67-9fe0-48d5-a807-14ea93f48c0f tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-572ac3c0-3685-4a92-bbab-af819119146f-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-dfc4deb2-ae79-4081-9b89-047f7e222623-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-dfc4deb2-ae79-4081-9b89-047f7e222623-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-dfc4deb2-ae79-4081-9b89-047f7e222623" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-dfc4deb2-ae79-4081-9b89-047f7e222623" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc0785-4b4b-43ba-8eb7-add84703e43c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:35 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 Jul 17 14:32:35 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:35 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:35 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623 Jul 17 14:32:35 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:36 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dfc4deb2-ae79-4081-9b89-047f7e222623" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-dfc4deb2-ae79-4081-9b89-047f7e222623" released by "delete_volume" :: held 0.625s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['54a3e4e9-a20c-4cdb-86bd-efd67ea849d8', 'e95fc47d-b240-4207-b382-3a11b96ce7d6', '8a3bcbe8-b437-41d4-becd-0a739c8b4e68', '7f18edca-86bd-4e77-b857-2bd6ffb0c5d5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:36 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:36 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:36 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.230s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:36 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-88d90411-0dbc-46da-9e84-62bf33b10f67 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-dfc4deb2-ae79-4081-9b89-047f7e222623-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-35848a89-0797-4c33-ad0a-2294efeeb006-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-35848a89-0797-4c33-ad0a-2294efeeb006-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-35848a89-0797-4c33-ad0a-2294efeeb006" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-35848a89-0797-4c33-ad0a-2294efeeb006" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleting offline snapshot 35848a89-0797-4c33-ad0a-2294efeeb006 of volume fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] snapshot_file for this snap is: volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c1d59-bea4-4c7a-bc36-bb364af7dc51]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:36 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 Jul 17 14:32:36 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:36 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb70516b-d34b-4323-8998-781188ea5ec2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b28507-2d3a-44d0-bd63-fc4517fef48c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:37 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 Jul 17 14:32:37 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:37 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2" returned: 0 in 0.363s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:37 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 Jul 17 14:32:37 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:37 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:37 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006 Jul 17 14:32:37 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:37 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2.35848a89-0797-4c33-ad0a-2294efeeb006" returned: 0 in 0.250s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-35848a89-0797-4c33-ad0a-2294efeeb006" released by "_delete_snapshot" :: held 1.388s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" released by "delete_snapshot" :: held 1.410s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['867307c6-522c-49a6-a98d-83c2243b32e1', '1e30c1e3-8311-4ff2-85ed-8bc7537c4ea4', '30d7782b-6fc2-40d8-bbbb-ebc30ef9132e', '13a8a37b-6d77-439a-b990-0d5b5a0880b2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:38 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Delete snapshot completed successfully. Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8658994-7256-40d5-8f31-46889d0ba8c0 tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-35848a89-0797-4c33-ad0a-2294efeeb006-delete_snapshot" released by "delete_snapshot" :: held 1.546s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-fb70516b-d34b-4323-8998-781188ea5ec2-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-fb70516b-d34b-4323-8998-781188ea5ec2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e5798-b8fc-4e9b-8464-5d90cb5c273a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:38 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 Jul 17 14:32:38 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:39 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:39 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2 Jul 17 14:32:39 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:39 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fb70516b-d34b-4323-8998-781188ea5ec2" returned: 0 in 0.254s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-quobyte-fb70516b-d34b-4323-8998-781188ea5ec2" released by "delete_volume" :: held 0.668s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Created reservations ['63043f95-a85c-47f9-b7d8-2d52379439d4', '8486e927-7ca2-4862-9434-1c29cb98e29d', '743e9deb-eb3d-43ff-a63a-bd6e8350dde5', '6581a56d-fe28-4a95-969a-198c92fa8fe8'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:39 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:39 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:39 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Deleted volume successfully. Jul 17 14:32:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-baeec4a9-0cd0-450c-a89b-36005d7e6fcc tempest-CreateVolumesFromSnapshotTest-1172162416 None] Lock "cinder-fb70516b-d34b-4323-8998-781188ea5ec2-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Flow 'volume_create_manager' (408f8153-76f5-485a-b2b3-6d587fe73b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35957754-24c4-49b5-978d-5664aca3295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35957754-24c4-49b5-978d-5664aca3295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129990420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2cce6d-6e57-45f5-bdcc-818b63909dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e345e0328245a191ee09b2bd1655b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:43Z,use_quota=True,user_id='6ffccb094cb34bc181d5f8185da4ef78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b01389-ba8e-4efc-a2d4-4e3354dfce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b01389-ba8e-4efc-a2d4-4e3354dfce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af6839f-f353-457f-883f-ca93e0306158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af6839f-f353-457f-883f-ca93e0306158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2cce6d-6e57-45f5-bdcc-818b63909dba', 'volume_name': 'volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e60677-7f38-4871-bc7e-f143d95ad420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e60677-7f38-4871-bc7e-f143d95ad420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8699f60e-8681-4438-8f89-e87cd53aebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:42 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Volume 8f2cce6d-6e57-45f5-bdcc-818b63909dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba', 'volume_size': 1} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129990420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2cce6d-6e57-45f5-bdcc-818b63909dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e345e0328245a191ee09b2bd1655b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:43Z,use_quota=True,user_id='6ffccb094cb34bc181d5f8185da4ef78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Creating volume 8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:32:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:42 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba 1073741824 Jul 17 14:32:42 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:43 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba 1073741824" returned: 0 in 0.403s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:43 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:43 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:43 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.241s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8699f60e-8681-4438-8f89-e87cd53aebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba4a379-1ab6-4e96-bcd4-d3baaab8b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Volume volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba (8f2cce6d-6e57-45f5-bdcc-818b63909dba): created successfully Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba4a379-1ab6-4e96-bcd4-d3baaab8b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Flow 'volume_create_manager' (408f8153-76f5-485a-b2b3-6d587fe73b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1783b91a-1383-4e23-99cb-2df517ecc45b tempest-VolumeDependencyTests-1169842438 None] Created volume successfully. Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Creating offline snapshot 960d80c4-1de4-41c4-9071-367161c45c7e of volume 8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3148f2a9-3061-402d-ad21-0af368f6bb98]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:44 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:44 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:44 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:44 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e 1G Jul 17 14:32:44 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:44 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e 1G" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:44 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:44 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:45 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:45 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e is being set with open permissions: ugo+rw Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:45 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:45 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:45 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.231s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:45 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info Jul 17 14:32:45 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:45 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:45 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info is being set with open permissions: ugo+rw Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:45 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info Jul 17 14:32:45 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:45 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.info" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4a772acb-3dbb-4e82-94ed-d5ae9bdbb8ea tempest-VolumeDependencyTests-1169842438 None] Create snapshot completed successfully Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Flow 'volume_create_manager' (29fd1213-2a19-460c-8402-19ae0f7bc688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3b8015-8ab5-462a-87a1-14ea76a6375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3b8015-8ab5-462a-87a1-14ea76a6375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1594043598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70799e2-8cad-4bcc-af19-a7ebd8da8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e345e0328245a191ee09b2bd1655b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=960d80c4-1de4-41c4-9071-367161c45c7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:32:46Z,use_quota=True,user_id='6ffccb094cb34bc181d5f8185da4ef78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db504e2-f463-45a6-bdc8-32ba3ed7ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db504e2-f463-45a6-bdc8-32ba3ed7ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3d181b-2c64-4dda-8551-26324052a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3d181b-2c64-4dda-8551-26324052a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e70799e2-8cad-4bcc-af19-a7ebd8da8fc6', 'volume_name': 'volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6', 'volume_size': 1, 'snapshot_id': '960d80c4-1de4-41c4-9071-367161c45c7e'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233f4d9f-7457-4511-8fe4-d18f14e5f8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233f4d9f-7457-4511-8fe4-d18f14e5f8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c5e80d-8462-4307-9bf5-92c185bc1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:46 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Volume e70799e2-8cad-4bcc-af19-a7ebd8da8fc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6', 'volume_size': 1, 'snapshot_id': '960d80c4-1de4-41c4-9071-367161c45c7e'} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Creating volume e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 from snapshot 960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] snapshot: 960d80c4-1de4-41c4-9071-367161c45c7e, volume: e70799e2-8cad-4bcc-af19-a7ebd8da8fc6, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904c7cd-e538-458e-925c-c1d37dc5e48a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:46 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:46 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:47 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f0c1a-8ffb-4fa7-8e87-4b330b36ba32]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:47 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:47 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:47 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:32:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:47 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 Jul 17 14:32:47 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:51 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" returned: 0 in 3.900s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ef5c1-9ac7-43e1-b384-f87df555be74]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:51 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:51 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:51 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.511s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba, size 1024.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:32:51 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Converted 1024.00 MB image at 262.51 MB/s Jul 17 14:32:51 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 is being set with open permissions: ugo+rw Jul 17 14:32:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:51 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 Jul 17 14:32:51 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:52 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" returned: 0 in 0.237s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" released by "_copy_volume_from_snapshot" :: held 5.469s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" released by "_create_volume_from_snapshot" :: held 5.500s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.516s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c5e80d-8462-4307-9bf5-92c185bc1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6', 'volume_size': 1, 'snapshot_id': '960d80c4-1de4-41c4-9071-367161c45c7e'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b9b1f-b5e4-4a13-a91c-0c69bd791f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:32:52 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Volume volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 (e70799e2-8cad-4bcc-af19-a7ebd8da8fc6): created successfully Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b9b1f-b5e4-4a13-a91c-0c69bd791f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:32:52 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Flow 'volume_create_manager' (29fd1213-2a19-460c-8402-19ae0f7bc688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:32:52 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-61e273b2-8a72-44a0-9d5c-35424d870156 tempest-VolumeDependencyTests-1169842438 None] Created volume successfully. Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-960d80c4-1de4-41c4-9071-367161c45c7e-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-960d80c4-1de4-41c4-9071-367161c45c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Deleting offline snapshot 960d80c4-1de4-41c4-9071-367161c45c7e of volume 8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] snapshot_file for this snap is: volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[62231e80-0afd-4d63-8c15-b5a872ac591c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:53 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:53 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:53 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[75425ec1-6f81-4d37-bfae-2c223cedebba]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:53 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:53 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:53 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:53 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:53 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:54 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.328s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:54 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e Jul 17 14:32:54 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:54 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba.960d80c4-1de4-41c4-9071-367161c45c7e" returned: 0 in 0.248s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-960d80c4-1de4-41c4-9071-367161c45c7e" released by "_delete_snapshot" :: held 1.386s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" released by "delete_snapshot" :: held 1.408s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Created reservations ['17cf8081-2d8d-4586-9382-410fedcd3d2a', '4abe976f-27a8-4611-8d75-7b825b608d37', '7380d85f-ca47-43b9-842d-50b47d2b14b4', 'b8ce3843-e062-4654-9694-7f716f90bf1b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Delete snapshot completed successfully. Jul 17 14:32:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8cdb0385-fec7-4b9c-90a8-f1e45999d570 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-960d80c4-1de4-41c4-9071-367161c45c7e-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-8f2cce6d-6e57-45f5-bdcc-818b63909dba-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-8f2cce6d-6e57-45f5-bdcc-818b63909dba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[930df809-21b1-4443-b388-adf10f8ac4ee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:55 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:55 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:55 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.381s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:55 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba Jul 17 14:32:55 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:55 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8f2cce6d-6e57-45f5-bdcc-818b63909dba" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-8f2cce6d-6e57-45f5-bdcc-818b63909dba" released by "delete_volume" :: held 0.683s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Created reservations ['7b6bd725-2f5a-4298-95bf-b9aa969f5cf4', '57c84811-d18f-4e3e-9e36-146553e79a0e', '92268f2b-67eb-4fa7-8322-ff75fd724c3b', '3aae7e5a-ae72-467f-a36b-bcba1d5aa82d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:56 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:56 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:56 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.269s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Deleted volume successfully. Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7346c66b-a9c8-4ba0-9fc3-73b6ea456124 tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-8f2cce6d-6e57-45f5-bdcc-818b63909dba-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[96721d5a-5bf1-44fb-9aa9-3d705cf1af96]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:56 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 Jul 17 14:32:56 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:56 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:56 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6 Jul 17 14:32:56 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:57 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" returned: 0 in 0.240s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-quobyte-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6" released by "delete_volume" :: held 0.632s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Created reservations ['530e66c6-d9fb-4a68-a93c-3b58b6ae003a', '41db85e9-3110-4277-9042-4ea275b84de7', '481cb5c3-7046-4091-81f8-119b07a0a14a', '5801d3a1-f42f-4a0e-9cc4-1403e85b3743'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:32:57 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:32:57 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:32:57 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.270s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:32:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Deleted volume successfully. Jul 17 14:32:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cbf8b657-f2e9-40ff-a456-58978356fc4b tempest-VolumeDependencyTests-1169842438 None] Lock "cinder-e70799e2-8cad-4bcc-af19-a7ebd8da8fc6-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Flow 'volume_create_manager' (fac74649-cd74-4bf0-b92b-a83160908e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c036d9-9c26-411c-864d-18aa7a202b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c036d9-9c26-411c-864d-18aa7a202b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680518530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd35150-0d5d-45ff-83cc-7b4ed144738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7186527f6ab64e258692aeea005a70fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:01Z,use_quota=True,user_id='ce0bcb7ad36a43eb82a100604c17dee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9a358-9090-4922-8ff6-107681cdc559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b9a358-9090-4922-8ff6-107681cdc559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b9f2b7-d814-49a6-8c91-ac2462d01ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b9f2b7-d814-49a6-8c91-ac2462d01ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd35150-0d5d-45ff-83cc-7b4ed144738f', 'volume_name': 'volume-edd35150-0d5d-45ff-83cc-7b4ed144738f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e687b2-3999-4a15-ac97-d6a5ddd66202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e687b2-3999-4a15-ac97-d6a5ddd66202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1c34f1-0f45-4167-bdbf-195362adb5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Volume edd35150-0d5d-45ff-83cc-7b4ed144738f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd35150-0d5d-45ff-83cc-7b4ed144738f', 'volume_size': 1} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680518530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd35150-0d5d-45ff-83cc-7b4ed144738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7186527f6ab64e258692aeea005a70fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:01Z,use_quota=True,user_id='ce0bcb7ad36a43eb82a100604c17dee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Creating volume edd35150-0d5d-45ff-83cc-7b4ed144738f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:33:01 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:01 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f 1073741824 Jul 17 14:33:01 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:01 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f 1073741824" returned: 0 in 0.421s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:01 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f Jul 17 14:33:01 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:01 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1c34f1-0f45-4167-bdbf-195362adb5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd35150-0d5d-45ff-83cc-7b4ed144738f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256adbf-63c9-4e7d-bdc8-daa2aff05abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Volume volume-edd35150-0d5d-45ff-83cc-7b4ed144738f (edd35150-0d5d-45ff-83cc-7b4ed144738f): created successfully Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256adbf-63c9-4e7d-bdc8-daa2aff05abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Flow 'volume_create_manager' (fac74649-cd74-4bf0-b92b-a83160908e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-45037d62-0f48-4780-a08e-a3ec7a63b220 tempest-ProjectReaderTests-374935531 None] Created volume successfully. Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Acquiring lock "cinder-edd35150-0d5d-45ff-83cc-7b4ed144738f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "cinder-edd35150-0d5d-45ff-83cc-7b4ed144738f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Acquiring lock "cinder-quobyte-edd35150-0d5d-45ff-83cc-7b4ed144738f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "cinder-quobyte-edd35150-0d5d-45ff-83cc-7b4ed144738f" acquired by "delete_volume" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3aca2-e34c-41df-ab8d-995b51e1a9e5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:02 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f Jul 17 14:33:02 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:02 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:02 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f Jul 17 14:33:02 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:02 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-edd35150-0d5d-45ff-83cc-7b4ed144738f" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "cinder-quobyte-edd35150-0d5d-45ff-83cc-7b4ed144738f" released by "delete_volume" :: held 0.625s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:02 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Created reservations ['1135d36b-b8d2-4726-b137-1e193f016f6b', 'd8dad4b8-80d1-49fe-b55e-6b1ba4a8327c', 'a26174a0-68ac-44f2-a8bf-e7a27d57a85a', '6f8bb266-7241-460f-b2ce-4720231eb5d7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:03 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:33:03 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:03 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.250s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:33:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Deleted volume successfully. Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ab37ee29-4898-468f-97f4-8b40afbd7219 tempest-ProjectReaderTests-374935531 None] Lock "cinder-edd35150-0d5d-45ff-83cc-7b4ed144738f-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Flow 'volume_create_manager' (5661461a-c438-4170-a61c-eb54f25ee278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246806e5-8eff-47b7-8115-0779192681fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246806e5-8eff-47b7-8115-0779192681fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160590212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888defd3-b9f2-495a-a1b3-55df4ce41a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7186527f6ab64e258692aeea005a70fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:04Z,use_quota=True,user_id='ce0bcb7ad36a43eb82a100604c17dee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f4c4ef-858e-4c4c-823b-a7157aabd646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f4c4ef-858e-4c4c-823b-a7157aabd646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbe07ca-f21b-4c98-be84-f19c7a73beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbe07ca-f21b-4c98-be84-f19c7a73beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888defd3-b9f2-495a-a1b3-55df4ce41a31', 'volume_name': 'volume-888defd3-b9f2-495a-a1b3-55df4ce41a31', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3dd6d1-b66f-43f4-a6c1-70deef66bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3dd6d1-b66f-43f4-a6c1-70deef66bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369089eb-6605-4dfc-a3d2-c83c9b0b619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Volume 888defd3-b9f2-495a-a1b3-55df4ce41a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888defd3-b9f2-495a-a1b3-55df4ce41a31', 'volume_size': 1} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160590212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888defd3-b9f2-495a-a1b3-55df4ce41a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7186527f6ab64e258692aeea005a70fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:04Z,use_quota=True,user_id='ce0bcb7ad36a43eb82a100604c17dee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Creating volume 888defd3-b9f2-495a-a1b3-55df4ce41a31 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:33:03 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:33:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:03 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 1073741824 Jul 17 14:33:03 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:04 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 1073741824" returned: 0 in 0.434s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:04 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 Jul 17 14:33:04 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:04 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369089eb-6605-4dfc-a3d2-c83c9b0b619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888defd3-b9f2-495a-a1b3-55df4ce41a31', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798a126-4016-49e7-a2ab-d4ffe3c69d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Volume volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 (888defd3-b9f2-495a-a1b3-55df4ce41a31): created successfully Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798a126-4016-49e7-a2ab-d4ffe3c69d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Flow 'volume_create_manager' (5661461a-c438-4170-a61c-eb54f25ee278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4d166746-4adc-496b-8dd1-796bee208858 tempest-ProjectReaderTests-374935531 None] Created volume successfully. Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Acquiring lock "cinder-888defd3-b9f2-495a-a1b3-55df4ce41a31-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "cinder-888defd3-b9f2-495a-a1b3-55df4ce41a31-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Acquiring lock "cinder-quobyte-888defd3-b9f2-495a-a1b3-55df4ce41a31" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "cinder-quobyte-888defd3-b9f2-495a-a1b3-55df4ce41a31" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[038db065-5eb8-40e7-ad61-607ca450a2ee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:05 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 Jul 17 14:33:05 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:05 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31" returned: 0 in 0.366s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:05 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31 Jul 17 14:33:05 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:05 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-888defd3-b9f2-495a-a1b3-55df4ce41a31" returned: 0 in 0.267s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "cinder-quobyte-888defd3-b9f2-495a-a1b3-55df4ce41a31" released by "delete_volume" :: held 0.676s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Created reservations ['85d10c5b-8701-426b-bd65-2a1031554490', '1bad124c-1508-471a-848c-cc1887b7c015', '698210f6-ee11-4268-83af-2fdced42c31c', '4229f628-7d29-44c3-95c8-91c75c34e9b9'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:05 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:33:05 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:06 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:06 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:33:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Deleted volume successfully. Jul 17 14:33:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b9807acf-d439-403a-9bc0-543ff896bad4 tempest-ProjectReaderTests-374935531 None] Lock "cinder-888defd3-b9f2-495a-a1b3-55df4ce41a31-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=87,cinder:UPDATE=112,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:33:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=135,cinder:SELECT=91,cinder:INSERT=23,cinder:DELETE=11 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:25 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:33:25 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:26 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.277s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:33:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:33:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:33:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Flow 'volume_create_manager' (c4b968c3-eae0-4665-829a-f77552f06169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c8da1-0c40-40e5-9bd6-3762ec23494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c8da1-0c40-40e5-9bd6-3762ec23494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010186623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39afef6a-1162-469e-885f-1e04ce0ccd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089a7a8a0e244ab78125f5473b9243ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:28Z,use_quota=True,user_id='2d1e282c6fe74a24bb9d0d8d06c45c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2427cc-3fb6-40d4-95c1-5a29f4bfe62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2427cc-3fb6-40d4-95c1-5a29f4bfe62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b4870-d52f-4b20-a212-1d48bad1c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b4870-d52f-4b20-a212-1d48bad1c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39afef6a-1162-469e-885f-1e04ce0ccd77', 'volume_name': 'volume-39afef6a-1162-469e-885f-1e04ce0ccd77', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f408e1-2870-4df5-bbeb-ad5a2cd1bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f408e1-2870-4df5-bbeb-ad5a2cd1bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c04809-5252-4038-bf13-fc0030e3c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Volume 39afef6a-1162-469e-885f-1e04ce0ccd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39afef6a-1162-469e-885f-1e04ce0ccd77', 'volume_size': 1} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010186623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39afef6a-1162-469e-885f-1e04ce0ccd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089a7a8a0e244ab78125f5473b9243ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:28Z,use_quota=True,user_id='2d1e282c6fe74a24bb9d0d8d06c45c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Creating volume 39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:33:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:28 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 1073741824 Jul 17 14:33:28 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:28 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 1073741824" returned: 0 in 0.430s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:28 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:28 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:28 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.244s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c04809-5252-4038-bf13-fc0030e3c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39afef6a-1162-469e-885f-1e04ce0ccd77', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf25d65-05dc-4bb8-bd1c-1585de0188db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:28 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Volume volume-39afef6a-1162-469e-885f-1e04ce0ccd77 (39afef6a-1162-469e-885f-1e04ce0ccd77): created successfully Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf25d65-05dc-4bb8-bd1c-1585de0188db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:28 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Flow 'volume_create_manager' (c4b968c3-eae0-4665-829a-f77552f06169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7ab98023-bf2b-427c-ac56-ed866f93dba6 tempest-SnapshotDependencyTests-751121932 None] Created volume successfully. Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Creating offline snapshot e3675455-26db-479c-8c57-c0e00ae25dc0 of volume 39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6984b8-35e3-4885-b9f6-6307a4f21b81]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:29 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:29 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:29 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:29 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 1G Jul 17 14:33:29 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:30 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 1G" returned: 0 in 0.397s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39afef6a-1162-469e-885f-1e04ce0ccd77 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:30 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39afef6a-1162-469e-885f-1e04ce0ccd77 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:30 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:30 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39afef6a-1162-469e-885f-1e04ce0ccd77 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:30 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 is being set with open permissions: ugo+rw Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:30 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:30 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:30 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.251s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:30 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info Jul 17 14:33:30 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:31 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info" returned: 0 in 0.263s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:31 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info is being set with open permissions: ugo+rw Jul 17 14:33:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:31 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info Jul 17 14:33:31 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:31 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.info" returned: 0 in 0.240s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c5d77410-1968-4b88-9c0e-9dd7043219b6 tempest-SnapshotDependencyTests-751121932 None] Create snapshot completed successfully Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Flow 'volume_create_manager' (1eaa2a70-2510-4689-8f6a-34c09fd5147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640aa36d-0042-41a5-9898-ea2af38813cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640aa36d-0042-41a5-9898-ea2af38813cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9512e5-2bfb-4156-8580-ce3445794688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089a7a8a0e244ab78125f5473b9243ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3675455-26db-479c-8c57-c0e00ae25dc0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:33:32Z,use_quota=True,user_id='2d1e282c6fe74a24bb9d0d8d06c45c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1179dab7-d460-40a3-b928-fec831455f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1179dab7-d460-40a3-b928-fec831455f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf9e2cd-3135-4833-ad34-b7e70bc55005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf9e2cd-3135-4833-ad34-b7e70bc55005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c9512e5-2bfb-4156-8580-ce3445794688', 'volume_name': 'volume-4c9512e5-2bfb-4156-8580-ce3445794688', 'volume_size': 1, 'snapshot_id': 'e3675455-26db-479c-8c57-c0e00ae25dc0'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413f54fd-2fb3-458c-839b-ac45083bd1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413f54fd-2fb3-458c-839b-ac45083bd1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c625e1f-4573-450c-ba85-371811096aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Volume 4c9512e5-2bfb-4156-8580-ce3445794688: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c9512e5-2bfb-4156-8580-ce3445794688', 'volume_size': 1, 'snapshot_id': 'e3675455-26db-479c-8c57-c0e00ae25dc0'} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0-4c9512e5-2bfb-4156-8580-ce3445794688" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0-4c9512e5-2bfb-4156-8580-ce3445794688" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Creating volume 4c9512e5-2bfb-4156-8580-ce3445794688 from snapshot e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] snapshot: e3675455-26db-479c-8c57-c0e00ae25dc0, volume: 4c9512e5-2bfb-4156-8580-ce3445794688, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[152a939e-8d37-4db8-b030-28e5ece242ed]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:32 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:32 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:32 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.372s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39afef6a-1162-469e-885f-1e04ce0ccd77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d050bc7b-7675-419a-8470-142d8fa1d14f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:32 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:32 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:33 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:33 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:33:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:33 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 Jul 17 14:33:33 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:36 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688" returned: 0 in 3.905s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:36 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5895ea41-deba-4711-96bd-bbf707459e40]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:37 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:37 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:37 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.515s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77, size 1024.00 MB, duration 3.91 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:33:37 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Converted 1024.00 MB image at 262.15 MB/s Jul 17 14:33:37 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 is being set with open permissions: ugo+rw Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:37 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 Jul 17 14:33:37 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:37 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688" returned: 0 in 0.240s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" released by "_copy_volume_from_snapshot" :: held 5.478s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0-4c9512e5-2bfb-4156-8580-ce3445794688" released by "_create_volume_from_snapshot" :: held 5.508s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.525s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c625e1f-4573-450c-ba85-371811096aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9512e5-2bfb-4156-8580-ce3445794688', 'volume_size': 1, 'snapshot_id': 'e3675455-26db-479c-8c57-c0e00ae25dc0'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa0560-d21d-4067-93bb-c4fcd5a42bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:33:37 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Volume volume-4c9512e5-2bfb-4156-8580-ce3445794688 (4c9512e5-2bfb-4156-8580-ce3445794688): created successfully Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa0560-d21d-4067-93bb-c4fcd5a42bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:33:37 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Flow 'volume_create_manager' (1eaa2a70-2510-4689-8f6a-34c09fd5147b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:33:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b5571344-3634-48dc-8ed0-8fadb70bdf6f tempest-SnapshotDependencyTests-751121932 None] Created volume successfully. Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-e3675455-26db-479c-8c57-c0e00ae25dc0-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-e3675455-26db-479c-8c57-c0e00ae25dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Deleting offline snapshot e3675455-26db-479c-8c57-c0e00ae25dc0 of volume 39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] snapshot_file for this snap is: volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe0ffa5-ac73-486c-ab52-8329ac6dff57]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:38 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:38 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:39 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.359s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39afef6a-1162-469e-885f-1e04ce0ccd77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36394a-7403-4aee-8aea-c5e69c582134]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:39 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:39 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:39 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.368s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:39 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:39 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:39 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.337s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:39 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0 Jul 17 14:33:39 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:40 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77.e3675455-26db-479c-8c57-c0e00ae25dc0" returned: 0 in 0.251s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-e3675455-26db-479c-8c57-c0e00ae25dc0" released by "_delete_snapshot" :: held 1.408s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" released by "delete_snapshot" :: held 1.434s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Created reservations ['14cefe51-3093-420a-a855-51ee807824f1', '89da8844-a741-4231-8f6b-37ad4109539a', '1afa5d34-f623-4fac-85b9-5ddb0d916e88', '441d7049-1066-48d6-88ca-ea22555e42bf'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:33:40 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Delete snapshot completed successfully. Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-33f56517-0f26-4a10-812d-4e2396f62b43 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-e3675455-26db-479c-8c57-c0e00ae25dc0-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-39afef6a-1162-469e-885f-1e04ce0ccd77-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-39afef6a-1162-469e-885f-1e04ce0ccd77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:40 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc88bd-a43a-4ea9-965a-ca79fdcfe4f6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:41 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:41 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:41 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.364s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:41 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77 Jul 17 14:33:41 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:41 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-39afef6a-1162-469e-885f-1e04ce0ccd77" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-39afef6a-1162-469e-885f-1e04ce0ccd77" released by "delete_volume" :: held 0.664s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Created reservations ['ffe9e9c6-f58b-4d7b-b2be-2c864a5abeff', '455733f1-568e-4b83-aebe-4b236105eadd', '9a98c1b0-136a-423a-b57a-2357c9579414', '5f9c6b26-b2e2-47f3-b80a-cd56c5b0ad12'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:41 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:33:41 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:42 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.269s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:33:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Deleted volume successfully. Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-858d7a7d-325e-4827-9f8a-f2af88656b81 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-39afef6a-1162-469e-885f-1e04ce0ccd77-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-4c9512e5-2bfb-4156-8580-ce3445794688-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-4c9512e5-2bfb-4156-8580-ce3445794688-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5090d4b-d767-484d-b85f-f2855dca113f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:42 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 Jul 17 14:33:42 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:42 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:42 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688 Jul 17 14:33:42 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:42 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4c9512e5-2bfb-4156-8580-ce3445794688" returned: 0 in 0.239s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-quobyte-4c9512e5-2bfb-4156-8580-ce3445794688" released by "delete_volume" :: held 0.637s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Created reservations ['022f7f32-b577-4286-8f29-d2993fa6c9bb', '3ab95850-3049-40c4-9bf2-b4b372f332ab', '7922dfba-5d96-4574-b0d5-24695fa41931', '9b64aaff-300d-4d5b-b60c-47d63f28dca7'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:33:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:33:42 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:33:42 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:33:43 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 17 14:33:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.237s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:33:43 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:33:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Deleted volume successfully. Jul 17 14:33:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-da2b197b-9995-4da2-a4ec-572d3c386f38 tempest-SnapshotDependencyTests-751121932 None] Lock "cinder-4c9512e5-2bfb-4156-8580-ce3445794688-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:33:52 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:33:53 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=27,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (5db22898-8f96-4382-83e5-4130a4bc49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c6442-4128-45f6-b081-8c1154596b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c6442-4128-45f6-b081-8c1154596b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116902405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feec17c5-609b-4746-a454-66ee765fe3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:02Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1849819-710a-4446-9e96-5b5532c92656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1849819-710a-4446-9e96-5b5532c92656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13217e2b-b033-48c8-b22e-9fc4e98fe687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13217e2b-b033-48c8-b22e-9fc4e98fe687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feec17c5-609b-4746-a454-66ee765fe3fb', 'volume_name': 'volume-feec17c5-609b-4746-a454-66ee765fe3fb', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b8d6db-6cf3-4bbe-8e3b-f8d52e7a46a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b8d6db-6cf3-4bbe-8e3b-f8d52e7a46a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d25706-0367-4f03-815b-a558d783b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume feec17c5-609b-4746-a454-66ee765fe3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feec17c5-609b-4746-a454-66ee765fe3fb', 'volume_size': 1} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116902405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feec17c5-609b-4746-a454-66ee765fe3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:02Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:02 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:02 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb 1073741824 Jul 17 14:34:02 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (edaf5e3b-c608-421e-a716-3c805505c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4e76d5-dd40-42f2-9bad-f4eac0e2a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4e76d5-dd40-42f2-9bad-f4eac0e2a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637036641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a39533-4e72-4c7d-b4b6-aff19f482735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:02Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9a92f-9892-4aef-a897-7afdd5fc8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9a92f-9892-4aef-a897-7afdd5fc8747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9156f255-d81a-4fa1-8661-6c6578a6e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9156f255-d81a-4fa1-8661-6c6578a6e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a39533-4e72-4c7d-b4b6-aff19f482735', 'volume_name': 'volume-55a39533-4e72-4c7d-b4b6-aff19f482735', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6d8489-e24c-417a-a067-bcef4839fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6d8489-e24c-417a-a067-bcef4839fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d1395-ffc4-4cb8-b4fe-c9607aa0b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Volume 55a39533-4e72-4c7d-b4b6-aff19f482735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a39533-4e72-4c7d-b4b6-aff19f482735', 'volume_size': 1} Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:02 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb 1073741824" returned: 0 in 0.672s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:03 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb Jul 17 14:34:03 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (b6cd270b-764c-48a5-867e-6dbccb89a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d246e729-51d6-427e-93e7-d3873ce71336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d246e729-51d6-427e-93e7-d3873ce71336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846272927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ed8393-d605-415b-aaf6-7e0b89f8e2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce46637c-b7fd-4735-9287-59171b3e66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce46637c-b7fd-4735-9287-59171b3e66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bd5560-c331-4047-9d58-aaf948228e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bd5560-c331-4047-9d58-aaf948228e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ed8393-d605-415b-aaf6-7e0b89f8e2d6', 'volume_name': 'volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e8e04-92e2-4df7-949e-451067cf6bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e8e04-92e2-4df7-949e-451067cf6bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675052e3-d125-4dbe-9057-4fcd34998e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Volume 64ed8393-d605-415b-aaf6-7e0b89f8e2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6', 'volume_size': 1} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:03 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637036641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a39533-4e72-4c7d-b4b6-aff19f482735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:02Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Creating volume 55a39533-4e72-4c7d-b4b6-aff19f482735 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:03 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 1073741824 Jul 17 14:34:03 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d25706-0367-4f03-815b-a558d783b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feec17c5-609b-4746-a454-66ee765fe3fb', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef16b271-8d7e-4d48-b554-e94a0a7c1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (863b688c-83c3-49d5-b517-3bd5290421bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8a12c9-8d22-42c2-b9cb-6a81721b19b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (305c1e8c-ca33-4f9f-9be2-23447fe76519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137729b-472d-4fa3-8d96-19ffee9c5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-feec17c5-609b-4746-a454-66ee765fe3fb (feec17c5-609b-4746-a454-66ee765fe3fb): created successfully Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef16b271-8d7e-4d48-b554-e94a0a7c1b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (5db22898-8f96-4382-83e5-4130a4bc49f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a4725fa8-9106-4cb8-8856-d49445a87dff tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8a12c9-8d22-42c2-b9cb-6a81721b19b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129903440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297b6943-60e9-4174-a304-ef402a530d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d75dd-f4b3-481a-8e67-dc3913f25d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d75dd-f4b3-481a-8e67-dc3913f25d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb32e7b-d80f-46cf-bfb0-053526454c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb32e7b-d80f-46cf-bfb0-053526454c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297b6943-60e9-4174-a304-ef402a530d00', 'volume_name': 'volume-297b6943-60e9-4174-a304-ef402a530d00', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdad36a3-af8a-4745-b87a-8f709d35ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdad36a3-af8a-4745-b87a-8f709d35ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479d8afe-c349-4184-9fb1-8b3bf4895eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Volume 297b6943-60e9-4174-a304-ef402a530d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297b6943-60e9-4174-a304-ef402a530d00', 'volume_size': 1} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137729b-472d-4fa3-8d96-19ffee9c5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989785671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8961b7-6cf5-4296-9a6a-0ac0b39c623f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c014be70-6837-4631-9232-bfee11725d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c014be70-6837-4631-9232-bfee11725d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab36c2c-45d2-4c31-a47d-cc4009312b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab36c2c-45d2-4c31-a47d-cc4009312b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8961b7-6cf5-4296-9a6a-0ac0b39c623f', 'volume_name': 'volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7688b78-bc99-43c5-96bc-cc12e2d9b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7688b78-bc99-43c5-96bc-cc12e2d9b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410d836e-e2e9-4141-8902-a9fd085f3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume 6c8961b7-6cf5-4296-9a6a-0ac0b39c623f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f', 'volume_size': 1} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (fe675d8d-3f20-498d-861a-759b4859d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de394c7-ce6e-453a-ba97-b33c7f75c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de394c7-ce6e-453a-ba97-b33c7f75c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899198132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30849123-1f8e-4e4c-ad07-1f3adb5cff29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:04Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d86b80-de54-488f-a427-9b2ffbecb786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d86b80-de54-488f-a427-9b2ffbecb786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be23c1a7-4ca3-4630-8ebc-9fee7f1036e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be23c1a7-4ca3-4630-8ebc-9fee7f1036e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30849123-1f8e-4e4c-ad07-1f3adb5cff29', 'volume_name': 'volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5025d4-dea3-40bc-aa0a-aa0b8cb0e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5025d4-dea3-40bc-aa0a-aa0b8cb0e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b044295-7b93-4cfa-92f3-aeb5ab30d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:03 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Volume 30849123-1f8e-4e4c-ad07-1f3adb5cff29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29', 'volume_size': 1} Jul 17 14:34:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:03 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 1073741824" returned: 0 in 0.621s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:04 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 Jul 17 14:34:04 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (275452eb-87d6-4e86-9cbd-76bcc1aea97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01b57e-b17e-4a39-b365-24c61c9b68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01b57e-b17e-4a39-b365-24c61c9b68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997969796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8345ac-3e68-4c08-b719-77d77276ef0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:04Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a9e64-a9c3-4c92-9864-57c15b127b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a9e64-a9c3-4c92-9864-57c15b127b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353cd776-03d6-4d9a-9977-7023ab93e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353cd776-03d6-4d9a-9977-7023ab93e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8345ac-3e68-4c08-b719-77d77276ef0c', 'volume_name': 'volume-da8345ac-3e68-4c08-b719-77d77276ef0c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3f458e-b9d7-4606-ab22-c0986a9f0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3f458e-b9d7-4606-ab22-c0986a9f0695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d6e574-6a04-474b-a4de-35fc28ec3ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Volume da8345ac-3e68-4c08-b719-77d77276ef0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8345ac-3e68-4c08-b719-77d77276ef0c', 'volume_size': 1} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:04 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735" returned: 0 in 0.277s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846272927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ed8393-d605-415b-aaf6-7e0b89f8e2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Creating volume 64ed8393-d605-415b-aaf6-7e0b89f8e2d6 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:04 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d1395-ffc4-4cb8-b4fe-c9607aa0b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a39533-4e72-4c7d-b4b6-aff19f482735', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 1073741824 Jul 17 14:34:04 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876d97d-fdce-460e-bb5c-29e3429d7a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:04 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Volume volume-55a39533-4e72-4c7d-b4b6-aff19f482735 (55a39533-4e72-4c7d-b4b6-aff19f482735): created successfully Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876d97d-fdce-460e-bb5c-29e3429d7a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (edaf5e3b-c608-421e-a716-3c805505c52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:04 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-963d3e62-fc17-4f0d-bb49-417764441644 tempest-CreateVolumesFromImageTest-2043069732 None] Created volume successfully. Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:04 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 1073741824" returned: 0 in 0.476s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:04 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 Jul 17 14:34:04 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:05 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" returned: 0 in 0.255s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129903440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297b6943-60e9-4174-a304-ef402a530d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Creating volume 297b6943-60e9-4174-a304-ef402a530d00 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675052e3-d125-4dbe-9057-4fcd34998e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:05 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 1073741824 Jul 17 14:34:05 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165280d-b64c-4464-b37e-052249e1f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Volume volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 (64ed8393-d605-415b-aaf6-7e0b89f8e2d6): created successfully Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165280d-b64c-4464-b37e-052249e1f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (b6cd270b-764c-48a5-867e-6dbccb89a254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e684317a-d691-4200-906a-6730fcc9657c tempest-CreateVolumesFromImageTest-2043069732 None] Created volume successfully. Jul 17 14:34:05 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 1073741824" returned: 0 in 0.468s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:05 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 Jul 17 14:34:05 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:05 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989785671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8961b7-6cf5-4296-9a6a-0ac0b39c623f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:03Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume 6c8961b7-6cf5-4296-9a6a-0ac0b39c623f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479d8afe-c349-4184-9fb1-8b3bf4895eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297b6943-60e9-4174-a304-ef402a530d00', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca868827-e230-485e-9dd5-5a7af060ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:05 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f 1073741824 Jul 17 14:34:05 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Volume volume-297b6943-60e9-4174-a304-ef402a530d00 (297b6943-60e9-4174-a304-ef402a530d00): created successfully Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca868827-e230-485e-9dd5-5a7af060ce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (863b688c-83c3-49d5-b517-3bd5290421bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-26ecb2a3-df14-4d59-bfd0-d61f9d212ca1 tempest-CreateVolumesFromImageTest-2043069732 None] Created volume successfully. Jul 17 14:34:06 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f 1073741824" returned: 0 in 0.517s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:06 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f Jul 17 14:34:06 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:06 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" returned: 0 in 0.254s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899198132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30849123-1f8e-4e4c-ad07-1f3adb5cff29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:04Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Creating volume 30849123-1f8e-4e4c-ad07-1f3adb5cff29 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:06 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:06 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 1073741824 Jul 17 14:34:06 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410d836e-e2e9-4141-8902-a9fd085f3035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cf043d-7094-47e1-a980-7bc92912d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Flow 'volume_create_manager' (09f7a7f6-8b16-4896-8d01-d536f9259f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f0791-234f-4571-bbaa-3906f93e123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f0791-234f-4571-bbaa-3906f93e123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0189d81-37d7-4f44-94e0-c1fbe6e28309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde0f20b562c402aa2bc910c7c14ea67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:07Z,use_quota=True,user_id='5021e6c5f9804d088e12bb3f85940d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac501810-17d6-427c-b11b-2b524f5ffd58),volume_type_id=ac501810-17d6-427c-b11b-2b524f5ffd58)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a43877-d090-424b-a797-674b5f82cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a43877-d090-424b-a797-674b5f82cafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51ff729-49f2-49f7-9df0-3f7f6da5049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:34:06 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f (6c8961b7-6cf5-4296-9a6a-0ac0b39c623f): created successfully Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cf043d-7094-47e1-a980-7bc92912d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (305c1e8c-ca33-4f9f-9be2-23447fe76519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8856562d-a73e-4293-8fb9-8f8fe77be706 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:07 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 1073741824" returned: 0 in 0.469s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51ff729-49f2-49f7-9df0-3f7f6da5049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0189d81-37d7-4f44-94e0-c1fbe6e28309', 'volume_name': 'volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309', 'volume_size': 1, 'image_id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7ceb5a50c37c29b9fc215ee0b388f0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cde0f20b562c402aa2bc910c7c14ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad5fb1bd15beb0bb331f52dd9f2eb69279c7f76326b859e8044ff2c4f1a5485e50f569753378cbdfb7b587d2f464a9ac7f0307a7966e90b950d7709d6f4b3bc', 'id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e512badd-37c2-4032-a194-f43581bc7b74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef82ef2-32fb-4cad-b266-aa966c07c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef82ef2-32fb-4cad-b266-aa966c07c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51c053f-556f-4d74-aaa3-cbfc7726b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Volume c0189d81-37d7-4f44-94e0-c1fbe6e28309: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309', 'volume_size': 1, 'image_id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7ceb5a50c37c29b9fc215ee0b388f0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cde0f20b562c402aa2bc910c7c14ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad5fb1bd15beb0bb331f52dd9f2eb69279c7f76326b859e8044ff2c4f1a5485e50f569753378cbdfb7b587d2f464a9ac7f0307a7966e90b950d7709d6f4b3bc', 'id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e512badd-37c2-4032-a194-f43581bc7b74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Trying to clone c0189d81-37d7-4f44-94e0-c1fbe6e28309 from image e512badd-37c2-4032-a194-f43581bc7b74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:07 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 Jul 17 14:34:07 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:34:07 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Image download 0.00 MB at 0.00 MB/s Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7981b2b-7c94-43de-81a8-ca52605ce4bf]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:07 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:07 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:07 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29" returned: 0 in 0.332s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.324s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997969796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8345ac-3e68-4c08-b719-77d77276ef0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afee55f240f044ca99ccc27cdeefa4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:04Z,use_quota=True,user_id='fdfa2865b4a74dbf9a5692b232b910fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Creating volume da8345ac-3e68-4c08-b719-77d77276ef0c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:07 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b044295-7b93-4cfa-92f3-aeb5ab30d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79571c-20d5-436b-acb4-df0e06491276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c 1073741824 Jul 17 14:34:07 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Volume volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 (30849123-1f8e-4e4c-ad07-1f3adb5cff29): created successfully Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79571c-20d5-436b-acb4-df0e06491276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (fe675d8d-3f20-498d-861a-759b4859d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ad6132e0-0183-47be-a2ab-6a2cdad89f5b tempest-CreateVolumesFromImageTest-2043069732 None] Created volume successfully. Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (19c84b6c-3d88-41d2-b5f0-86bfde4b1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1cd8ca-a9dd-4ded-bfb9-0e47f77a6c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1cd8ca-a9dd-4ded-bfb9-0e47f77a6c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387144410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c525734-fcfb-416b-928c-f81d4c18dcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:08Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04265bfe-b7e3-4c34-9857-6f9f75693be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04265bfe-b7e3-4c34-9857-6f9f75693be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36ceed-85fa-4739-8852-cce95fd1875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36ceed-85fa-4739-8852-cce95fd1875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c525734-fcfb-416b-928c-f81d4c18dcd4', 'volume_name': 'volume-7c525734-fcfb-416b-928c-f81d4c18dcd4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b969cd94-b279-4b65-a899-1116de751784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b969cd94-b279-4b65-a899-1116de751784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c60f93-e67f-4147-8c57-dbec15d3bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume 7c525734-fcfb-416b-928c-f81d4c18dcd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c525734-fcfb-416b-928c-f81d4c18dcd4', 'volume_size': 1} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:08 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:08 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:08 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c 1073741824" returned: 0 in 0.569s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:08 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c Jul 17 14:34:08 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:08 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (8d2b0f40-d17e-497a-81e7-37e1a83e2b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7d10b5-7748-4291-9db9-b27102fcedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Temporary image e512badd-37c2-4032-a194-f43581bc7b74 is fetched for user 5021e6c5f9804d088e12bb3f85940d40. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7d10b5-7748-4291-9db9-b27102fcedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909170139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb7d3e-58bb-4fca-ba77-027a090f42a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:08Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5447d46f-377b-4fa3-a1a0-20a8828e7580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5447d46f-377b-4fa3-a1a0-20a8828e7580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc516d4-4209-421e-9243-86096af45628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc516d4-4209-421e-9243-86096af45628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bb7d3e-58bb-4fca-ba77-027a090f42a6', 'volume_name': 'volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a3befd-3c2e-4cb1-b908-266f69d75ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a3befd-3c2e-4cb1-b908-266f69d75ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff45cde-73a7-4e19-aa05-02a1b5dfdd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume 05bb7d3e-58bb-4fca-ba77-027a090f42a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6', 'volume_size': 1} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a96fb97-c8dc-4418-b32a-802ebe6cc8eb]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:08 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:08 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:08 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c" returned: 0 in 0.482s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.157s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating offline snapshot 9df23a94-b967-4bc1-93ca-5e8b3ac68fcc of volume feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d6e574-6a04-474b-a4de-35fc28ec3ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8345ac-3e68-4c08-b719-77d77276ef0c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b78ed2-67d6-45bf-b1e1-4ee99fb79b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (b1b50731-c638-4706-b7fd-59bad4cf894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16f18a8-50a1-4022-bb90-d7813ab753a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb00911b-f0eb-4430-b897-5ff20e9b88c9]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:08 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16f18a8-50a1-4022-bb90-d7813ab753a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300415948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83680c5f-8cff-474a-87d5-014a9ee44b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cf09ca-de16-43af-82b0-b38fd272733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cf09ca-de16-43af-82b0-b38fd272733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384b482-e303-4c21-82af-1429301ee17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384b482-e303-4c21-82af-1429301ee17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83680c5f-8cff-474a-87d5-014a9ee44b4c', 'volume_name': 'volume-83680c5f-8cff-474a-87d5-014a9ee44b4c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d3d2c7-c18c-4643-a0e7-61227c753677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d3d2c7-c18c-4643-a0e7-61227c753677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3958f28-1018-4e14-8a8d-480e76720157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume 83680c5f-8cff-474a-87d5-014a9ee44b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83680c5f-8cff-474a-87d5-014a9ee44b4c', 'volume_size': 1} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:08 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb Jul 17 14:34:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Volume volume-da8345ac-3e68-4c08-b719-77d77276ef0c (da8345ac-3e68-4c08-b719-77d77276ef0c): created successfully Jul 17 14:34:08 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b78ed2-67d6-45bf-b1e1-4ee99fb79b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Flow 'volume_create_manager' (275452eb-87d6-4e86-9cbd-76bcc1aea97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1cd62e63-211e-4c21-8ea5-78816586969a tempest-CreateVolumesFromImageTest-2043069732 None] Created volume successfully. Jul 17 14:34:08 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:09 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (c4f1f3fd-0968-41d4-8d67-b3e2de8106e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d256f0b-e3f2-4b1b-969d-16c747b657d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d256f0b-e3f2-4b1b-969d-16c747b657d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398852491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1bb149-eb8f-44b6-a6be-c251db02f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c7f643-7cd8-4574-aabc-9ed6dba4775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c7f643-7cd8-4574-aabc-9ed6dba4775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c801b7-9635-407e-b585-dc70c74092e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c801b7-9635-407e-b585-dc70c74092e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1bb149-eb8f-44b6-a6be-c251db02f3c9', 'volume_name': 'volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c05d0f7-cdde-4346-9288-57253a317186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c05d0f7-cdde-4346-9288-57253a317186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a072d09c-fe8a-4293-a4b7-db1a57a78708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume af1bb149-eb8f-44b6-a6be-c251db02f3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9', 'volume_size': 1} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb" returned: 0 in 0.441s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:09 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc 1G Jul 17 14:34:09 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (666a9167-cac1-46e0-85b1-18979752971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe3584b-2869-410f-a113-592f8e7313fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe3584b-2869-410f-a113-592f8e7313fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502929903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc18768c-b3c5-4248-ac0a-3a5b49d1d968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8018b1bf-bfac-4cc9-9dc1-c4c51b4db3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8018b1bf-bfac-4cc9-9dc1-c4c51b4db3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bbdcfd-1bc0-4310-b257-a63620029c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bbdcfd-1bc0-4310-b257-a63620029c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc18768c-b3c5-4248-ac0a-3a5b49d1d968', 'volume_name': 'volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f50ac0-ea9b-4289-bd0c-cb84a0d0efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f50ac0-ea9b-4289-bd0c-cb84a0d0efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8720797c-380b-4a77-ba26-c28ee34d6b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume cc18768c-b3c5-4248-ac0a-3a5b49d1d968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968', 'volume_size': 1} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:09 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc 1G" returned: 0 in 0.433s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feec17c5-609b-4746-a454-66ee765fe3fb -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:09 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feec17c5-609b-4746-a454-66ee765fe3fb -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc Jul 17 14:34:09 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-da8345ac-3e68-4c08-b719-77d77276ef0c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-da8345ac-3e68-4c08-b719-77d77276ef0c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-quobyte-da8345ac-3e68-4c08-b719-77d77276ef0c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-da8345ac-3e68-4c08-b719-77d77276ef0c" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0812af21-07cf-49dc-8741-1b5ac1f38f7f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feec17c5-609b-4746-a454-66ee765fe3fb -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" returned: 0 in 0.317s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc is being set with open permissions: ugo+rw Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc Jul 17 14:34:10 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c Jul 17 14:34:10 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info Jul 17 14:34:10 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c" returned: 0 in 0.372s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c Jul 17 14:34:10 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info is being set with open permissions: ugo+rw Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info Jul 17 14:34:10 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-da8345ac-3e68-4c08-b719-77d77276ef0c" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-da8345ac-3e68-4c08-b719-77d77276ef0c" released by "delete_volume" :: held 0.667s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Created reservations ['3a073e41-d6f4-4292-8200-b5e430696c2f', '40253ca5-d936-45b4-9764-7461dc3dda36', '6924b451-176e-4c2e-b46b-96d6e6d74966', '5e8cce64-4d4e-4f33-acdb-26213c17d6dc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:10 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.info" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387144410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c525734-fcfb-416b-928c-f81d4c18dcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:08Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume 7c525734-fcfb-416b-928c-f81d4c18dcd4 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:10 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:10 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 1073741824 Jul 17 14:34:10 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-301eb652-36be-4436-a545-ec586c6c8eac tempest-CreateVolumesFromSnapshotTest-553659393 None] Create snapshot completed successfully Jul 17 14:34:11 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.275s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Deleted volume successfully. Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-30849123-1f8e-4e4c-ad07-1f3adb5cff29-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d1b7ddbf-8f86-416a-9627-c7d2cd7c4449 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-da8345ac-3e68-4c08-b719-77d77276ef0c-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-30849123-1f8e-4e4c-ad07-1f3adb5cff29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-quobyte-30849123-1f8e-4e4c-ad07-1f3adb5cff29" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-30849123-1f8e-4e4c-ad07-1f3adb5cff29" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a90a2f-d882-4507-956e-6fe43cfb96c5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:11 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 Jul 17 14:34:11 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:11 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 1073741824" returned: 0 in 0.489s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:11 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 Jul 17 14:34:11 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:11 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29" returned: 0 in 0.389s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:11 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29 Jul 17 14:34:11 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:11 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4" returned: 0 in 0.250s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909170139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb7d3e-58bb-4fca-ba77-027a090f42a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:08Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume 05bb7d3e-58bb-4fca-ba77-027a090f42a6 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:11 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:11 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 1073741824 Jul 17 14:34:11 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c60f93-e67f-4147-8c57-dbec15d3bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c525734-fcfb-416b-928c-f81d4c18dcd4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85805f32-e980-4cf5-87a4-77ed34bd0547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:11 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 (7c525734-fcfb-416b-928c-f81d4c18dcd4): created successfully Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85805f32-e980-4cf5-87a4-77ed34bd0547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (19c84b6c-3d88-41d2-b5f0-86bfde4b1158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:11 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-660458ec-5dff-48de-94b7-f1c31ceb06cf tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:11 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-30849123-1f8e-4e4c-ad07-1f3adb5cff29" returned: 0 in 0.259s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-30849123-1f8e-4e4c-ad07-1f3adb5cff29" released by "delete_volume" :: held 0.686s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Created reservations ['0fd1b245-1208-4f61-83ff-0ec23a5a24a7', 'ef86ab97-612c-43aa-aa25-527c84357056', '2739a07d-9c65-4a86-b1d1-a2469015a6e0', 'f90d5f85-67a4-4acc-ac74-b62cad65ca12'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:11 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:11 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:12 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 1073741824" returned: 0 in 0.544s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-297b6943-60e9-4174-a304-ef402a530d00-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:12 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-297b6943-60e9-4174-a304-ef402a530d00-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:12 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:12 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-quobyte-297b6943-60e9-4174-a304-ef402a530d00" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.408s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Deleted volume successfully. Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-297b6943-60e9-4174-a304-ef402a530d00" acquired by "delete_volume" :: waited 0.039s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-84ed15fb-31ad-46c8-ad0c-c4cd03eb5852 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-30849123-1f8e-4e4c-ad07-1f3adb5cff29-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5fe65b-3082-47a3-8821-12a816182a49]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (3c128da0-9181-4abc-a297-50a7f481323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384138d2-a986-4876-8392-fd9b8cf7fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384138d2-a986-4876-8392-fd9b8cf7fb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949220550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebae69a-2810-4686-b3aa-6da6f4f50603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:12Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2563eca6-c2c7-4831-baac-908d22943bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2563eca6-c2c7-4831-baac-908d22943bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7280e92-556d-4aa0-bd8f-a882e614a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 Jul 17 14:34:12 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7280e92-556d-4aa0-bd8f-a882e614a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebae69a-2810-4686-b3aa-6da6f4f50603', 'volume_name': 'volume-2ebae69a-2810-4686-b3aa-6da6f4f50603', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf3381c-1e0a-4a59-b12f-36f8b6e9151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf3381c-1e0a-4a59-b12f-36f8b6e9151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787c1666-e8a9-4670-aaf6-ae76005cc1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume 2ebae69a-2810-4686-b3aa-6da6f4f50603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebae69a-2810-4686-b3aa-6da6f4f50603', 'volume_size': 1} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6" returned: 0 in 0.418s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.722s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300415948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83680c5f-8cff-474a-87d5-014a9ee44b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume 83680c5f-8cff-474a-87d5-014a9ee44b4c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:12 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff45cde-73a7-4e19-aa05-02a1b5dfdd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d90c0-0983-4e55-99f8-a5cef67d2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:12 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c 1073741824 Jul 17 14:34:12 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:12 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 (05bb7d3e-58bb-4fca-ba77-027a090f42a6): created successfully Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d90c0-0983-4e55-99f8-a5cef67d2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (8d2b0f40-d17e-497a-81e7-37e1a83e2b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cd682e56-d83a-4155-8969-03efa0077650 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:12 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (fcc11692-1364-4375-8518-611a2ca97bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf51511-accb-43be-87ef-24f0e983d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00" returned: 0 in 0.569s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf51511-accb-43be-87ef-24f0e983d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175921080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7ca095-bfb9-4cf7-9783-20739de2c03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:13Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00 Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73282fe-5f41-4633-b25f-c48d778f3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73282fe-5f41-4633-b25f-c48d778f3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c88917-99b5-4ab0-ab50-975789db2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c88917-99b5-4ab0-ab50-975789db2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7ca095-bfb9-4cf7-9783-20739de2c03d', 'volume_name': 'volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d1345-ab33-4106-bc7f-395ef5a3047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d1345-ab33-4106-bc7f-395ef5a3047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb41ceab-03fc-4e7f-b471-885c4e5cc5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume 2d7ca095-bfb9-4cf7-9783-20739de2c03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d', 'volume_size': 1} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:13 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c 1073741824" returned: 0 in 0.605s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:13 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-297b6943-60e9-4174-a304-ef402a530d00" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-297b6943-60e9-4174-a304-ef402a530d00" released by "delete_volume" :: held 0.946s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:13 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c Jul 17 14:34:13 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (7ee217f2-a028-44f3-a384-d3412f97357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f207b2-c1ea-44d9-850b-3bde71512a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f207b2-c1ea-44d9-850b-3bde71512a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046605489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2c0fa-72fd-4fc0-8753-a40cefdad348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:13Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18623d5b-b396-41ac-8086-bb762d5f5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18623d5b-b396-41ac-8086-bb762d5f5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f42cd67-5200-414a-a9c5-52af6b288108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f42cd67-5200-414a-a9c5-52af6b288108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b2c0fa-72fd-4fc0-8753-a40cefdad348', 'volume_name': 'volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf77352-17fb-459a-97f5-9e6e3a6a19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf77352-17fb-459a-97f5-9e6e3a6a19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3274ddb0-3d2f-4239-a429-2e41e4b67b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume d3b2c0fa-72fd-4fc0-8753-a40cefdad348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348', 'volume_size': 1} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Created reservations ['93b015be-fadf-4d55-a8ce-e665fb429e31', 'c5882655-ff23-481f-9878-f761cc27d0ac', 'be66edfe-1a35-42f2-9932-50ed1886f612', '71021db3-8d48-463d-bf29-fd8e2ce55074'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:13 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:13 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:13 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.521s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398852491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1bb149-eb8f-44b6-a6be-c251db02f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume af1bb149-eb8f-44b6-a6be-c251db02f3c9 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:13 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:13 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 1073741824 Jul 17 14:34:13 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3958f28-1018-4e14-8a8d-480e76720157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83680c5f-8cff-474a-87d5-014a9ee44b4c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e66b10f-7ee1-4ca2-b47c-fb332a07062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-83680c5f-8cff-474a-87d5-014a9ee44b4c (83680c5f-8cff-474a-87d5-014a9ee44b4c): created successfully Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e66b10f-7ee1-4ca2-b47c-fb332a07062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (b1b50731-c638-4706-b7fd-59bad4cf894c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (bac07a73-4748-4095-83c9-67f750465abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3c1a42-6817-49a8-adb3-376c5f74703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3c1a42-6817-49a8-adb3-376c5f74703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015252664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f59da8-ab27-4e57-86e2-6affd7117f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:14Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3378ab8-7331-4efa-834f-bd9f8c9f92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3378ab8-7331-4efa-834f-bd9f8c9f92a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89a5ec2-6423-4a1a-b59a-07bf8ad4dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89a5ec2-6423-4a1a-b59a-07bf8ad4dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f59da8-ab27-4e57-86e2-6affd7117f2b', 'volume_name': 'volume-60f59da8-ab27-4e57-86e2-6affd7117f2b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd47436-db29-4bdb-a8bb-b9e211a47913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd47436-db29-4bdb-a8bb-b9e211a47913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73644d4-d2da-48eb-8823-9b57c8ecbade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume 60f59da8-ab27-4e57-86e2-6affd7117f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f59da8-ab27-4e57-86e2-6affd7117f2b', 'volume_size': 1} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.364s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:13 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-41d8fb06-ba61-4bd3-9ed2-e2d558e94f36 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Deleted volume successfully. Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7d4c49fe-2fb9-415e-b03b-369c3daaf5a7 tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-297b6943-60e9-4174-a304-ef402a530d00-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:14 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 1073741824" returned: 0 in 0.514s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:14 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 Jul 17 14:34:14 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (dddc5818-cb53-4fe4-bcec-a0a8e8a51a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc64dcd-c670-4c18-af14-b69e74904af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc64dcd-c670-4c18-af14-b69e74904af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110277343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d0a8cd-16f4-4042-8a9b-298445733f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:14Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f878b-368d-4892-9e69-5d8aabc50eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f878b-368d-4892-9e69-5d8aabc50eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab08cd-fe2b-49d6-be84-65e7fbbf4aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab08cd-fe2b-49d6-be84-65e7fbbf4aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d0a8cd-16f4-4042-8a9b-298445733f94', 'volume_name': 'volume-77d0a8cd-16f4-4042-8a9b-298445733f94', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbeab21-545b-420e-964d-46c14fed2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbeab21-545b-420e-964d-46c14fed2234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c06b25-601b-42ec-a9c2-3463f1dad480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume 77d0a8cd-16f4-4042-8a9b-298445733f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d0a8cd-16f4-4042-8a9b-298445733f94', 'volume_size': 1} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-64ed8393-d605-415b-aaf6-7e0b89f8e2d6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-64ed8393-d605-415b-aaf6-7e0b89f8e2d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-quobyte-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b96899-73df-4030-b259-a29de103dede]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:14 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9" returned: 0 in 0.292s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.387s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0189d81-37d7-4f44-94e0-c1fbe6e28309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde0f20b562c402aa2bc910c7c14ea67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:07Z,use_quota=True,user_id='5021e6c5f9804d088e12bb3f85940d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac501810-17d6-427c-b11b-2b524f5ffd58),volume_type_id=ac501810-17d6-427c-b11b-2b524f5ffd58)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Creating volume c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:14 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1073741824 Jul 17 14:34:14 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a072d09c-fe8a-4293-a4b7-db1a57a78708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e767803-540e-4162-bd58-260c7136da4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 (af1bb149-eb8f-44b6-a6be-c251db02f3c9): created successfully Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e767803-540e-4162-bd58-260c7136da4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (c4f1f3fd-0968-41d4-8d67-b3e2de8106e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6bb520de-6f42-4c47-ad2f-81f7c807007d tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:14 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 Jul 17 14:34:14 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" returned: 0 in 0.369s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6 Jul 17 14:34:15 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1073741824" returned: 0 in 0.432s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 Jul 17 14:34:15 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" returned: 0 in 0.241s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-64ed8393-d605-415b-aaf6-7e0b89f8e2d6" released by "delete_volume" :: held 0.658s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Created reservations ['1ea7a693-74da-4493-88f8-b9090e8ca577', 'b85e46db-1538-4080-ac6c-8b71ed2655f9', 'fd2788f6-2b75-4054-9d21-b54ac03995ae', '2034a50f-be14-4506-a1fc-4eab8719d8c0'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:15 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.793s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502929903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc18768c-b3c5-4248-ac0a-3a5b49d1d968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6b0a18fcd0492ca2a33392a2581052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:09Z,use_quota=True,user_id='10d3c3eb572246f9b80a2a04e99dcf83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Creating volume cc18768c-b3c5-4248-ac0a-3a5b49d1d968 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:15 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:15 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:15 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 1073741824 Jul 17 14:34:15 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Attempting download of e512badd-37c2-4032-a194-f43581bc7b74 ((None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}])) to volume c0189d81-37d7-4f44-94e0-c1fbe6e28309. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbeba28-dbe9-46bd-9029-a46545be8bde]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob Jul 17 14:34:15 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.264s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Deleted volume successfully. Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-55a39533-4e72-4c7d-b4b6-aff19f482735-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7997ad37-38be-4183-b276-7eb1d6a728bd tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-64ed8393-d605-415b-aaf6-7e0b89f8e2d6-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-55a39533-4e72-4c7d-b4b6-aff19f482735-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "cinder-quobyte-55a39533-4e72-4c7d-b4b6-aff19f482735" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-55a39533-4e72-4c7d-b4b6-aff19f482735" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e60bdc-eb9e-4844-ad70-c1e46f76f34f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 1073741824" returned: 0 in 0.478s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:15 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob" returned: 0 in 0.412s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:15 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 Jul 17 14:34:16 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob Jul 17 14:34:16 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735" returned: 0 in 0.382s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735 Jul 17 14:34:16 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" returned: 0 in 0.263s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.578s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949220550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebae69a-2810-4686-b3aa-6da6f4f50603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:12Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume 2ebae69a-2810-4686-b3aa-6da6f4f50603 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8720797c-380b-4a77-ba26-c28ee34d6b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:16 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 1073741824 Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ca9044-e509-4305-828f-c170c16e5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:16 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob" returned: 1 in 0.353s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e512badd-37c2-4032-a194-f43581bc7b74_msn1m3ob' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba61726-4e57-4acc-ae34-f6da81c9ec45]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Volume volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 (cc18768c-b3c5-4248-ac0a-3a5b49d1d968): created successfully Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ca9044-e509-4305-828f-c170c16e5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Flow 'volume_create_manager' (666a9167-cac1-46e0-85b1-18979752971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a390bcf5-dd89-4e5b-8180-76635b94bff3 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created volume successfully. Jul 17 14:34:16 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:16 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-55a39533-4e72-4c7d-b4b6-aff19f482735" returned: 0 in 0.326s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-quobyte-55a39533-4e72-4c7d-b4b6-aff19f482735" released by "delete_volume" :: held 0.746s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Created reservations ['6d00998f-0c45-4e3b-a9c9-12ca03b868e9', '175c1742-76ef-408d-848f-feccb590e4ff', 'e72ea2ec-d59a-49db-a5d6-f3ab569427b1', '4479f99c-a8ec-4d16-8508-a123099bcd9e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:16 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:16 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 1073741824" returned: 0 in 0.491s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:16 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD Jul 17 14:34:16 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 Jul 17 14:34:16 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:16 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Deleted volume successfully. Jul 17 14:34:17 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] e512badd-37c2-4032-a194-f43581bc7b74 was raw, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:34:17 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603" returned: 0 in 0.275s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.983s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175921080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7ca095-bfb9-4cf7-9783-20739de2c03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:13Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume 2d7ca095-bfb9-4cf7-9783-20739de2c03d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:17 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 Jul 17 14:34:17 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:17 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787c1666-e8a9-4670-aaf6-ae76005cc1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebae69a-2810-4686-b3aa-6da6f4f50603', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:17 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d 1073741824 Jul 17 14:34:17 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be31dda7-f52e-493c-883b-3c6954eb32f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-99a9ef3e-b3bb-4260-8eb0-eac7848c824c tempest-CreateVolumesFromImageTest-2043069732 None] Lock "cinder-55a39533-4e72-4c7d-b4b6-aff19f482735-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 (2ebae69a-2810-4686-b3aa-6da6f4f50603): created successfully Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be31dda7-f52e-493c-883b-3c6954eb32f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (3c128da0-9181-4abc-a297-50a7f481323a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-cc18768c-b3c5-4248-ac0a-3a5b49d1d968-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-fa12c3d7-105d-43af-8d6e-c83a3ab7716e tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-cc18768c-b3c5-4248-ac0a-3a5b49d1d968-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[953ffd23-2941-4299-a073-fa7d8b28c084]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 Jul 17 14:34:17 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:17 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d 1073741824" returned: 0 in 0.570s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309" returned: 0 in 0.666s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e512badd-37c2-4032-a194-f43581bc7b74_ma0y69xfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:34:17 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d Jul 17 14:34:17 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:17 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1G Jul 17 14:34:17 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:17 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" returned: 0 in 0.484s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:17 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968 Jul 17 14:34:17 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:18 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d" returned: 0 in 0.340s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.518s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046605489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2c0fa-72fd-4fc0-8753-a40cefdad348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:13Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume d3b2c0fa-72fd-4fc0-8753-a40cefdad348 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:18 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb41ceab-03fc-4e7f-b471-885c4e5cc5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d011e0-98ba-4c20-993f-05568a358c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:18 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:18 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 1073741824 Jul 17 14:34:18 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d (2d7ca095-bfb9-4cf7-9783-20739de2c03d): created successfully Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d011e0-98ba-4c20-993f-05568a358c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (fcc11692-1364-4375-8518-611a2ca97bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 1G" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Downloaded image e512badd-37c2-4032-a194-f43581bc7b74 ((None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}])) to volume c0189d81-37d7-4f44-94e0-c1fbe6e28309 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Temporary image e512badd-37c2-4032-a194-f43581bc7b74 for user 5021e6c5f9804d088e12bb3f85940d40 is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Marking volume c0189d81-37d7-4f44-94e0-c1fbe6e28309 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Copying metadata from image e512badd-37c2-4032-a194-f43581bc7b74 to c0189d81-37d7-4f44-94e0-c1fbe6e28309. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Creating volume glance metadata for volume c0189d81-37d7-4f44-94e0-c1fbe6e28309 backed by image e512badd-37c2-4032-a194-f43581bc7b74 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a7ceb5a50c37c29b9fc215ee0b388f0a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:34:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d0a697d0-6601-4e7f-b95a-c03c7779c1a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51c053f-556f-4d74-aaa3-cbfc7726b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309', 'volume_size': 1, 'image_id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e512badd-37c2-4032-a194-f43581bc7b74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7ceb5a50c37c29b9fc215ee0b388f0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cde0f20b562c402aa2bc910c7c14ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ad5fb1bd15beb0bb331f52dd9f2eb69279c7f76326b859e8044ff2c4f1a5485e50f569753378cbdfb7b587d2f464a9ac7f0307a7966e90b950d7709d6f4b3bc', 'id': 'e512badd-37c2-4032-a194-f43581bc7b74', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e512badd-37c2-4032-a194-f43581bc7b74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a28ae9-7462-4562-ac23-e17aaf9c029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Volume volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 (c0189d81-37d7-4f44-94e0-c1fbe6e28309): created successfully Jul 17 14:34:18 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a28ae9-7462-4562-ac23-e17aaf9c029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Flow 'volume_create_manager' (09f7a7f6-8b16-4896-8d01-d536f9259f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" returned: 0 in 0.390s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d9b5f553-ab15-4b1c-b10a-351433e1a256 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Created volume successfully. Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-cc18768c-b3c5-4248-ac0a-3a5b49d1d968" released by "delete_volume" :: held 0.932s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['6f921996-036d-4b9c-9401-bdb23e6f0df5', '6ec7c6db-22fc-42d6-9d14-ea621f1e40e3', 'a49e7957-bb3b-4edd-984b-3fc4ff259c60', 'e2670d65-3a8c-45de-8327-04089b536e86'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:18 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:18 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-af1bb149-eb8f-44b6-a6be-c251db02f3c9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-af1bb149-eb8f-44b6-a6be-c251db02f3c9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-af1bb149-eb8f-44b6-a6be-c251db02f3c9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-af1bb149-eb8f-44b6-a6be-c251db02f3c9" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb1f21-3969-4e25-b1b1-027c9f16b13f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Acquiring lock "cinder-c0189d81-37d7-4f44-94e0-c1fbe6e28309-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:18 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 1073741824" returned: 0 in 0.751s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "cinder-c0189d81-37d7-4f44-94e0-c1fbe6e28309-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:18 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 Jul 17 14:34:18 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Acquiring lock "cinder-quobyte-c0189d81-37d7-4f44-94e0-c1fbe6e28309" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:18 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 Jul 17 14:34:18 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "cinder-quobyte-c0189d81-37d7-4f44-94e0-c1fbe6e28309" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:18 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.468s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:18 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[25caee4a-455c-43f8-ad38-9a70956ca6b6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e6396166-8f38-4dc3-99be-aaeca4a425bc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-cc18768c-b3c5-4248-ac0a-3a5b49d1d968-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:19 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 Jul 17 14:34:19 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:19 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9" returned: 0 in 0.484s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:19 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.248s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015252664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f59da8-ab27-4e57-86e2-6affd7117f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:14Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume 60f59da8-ab27-4e57-86e2-6affd7117f2b {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:19 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:19 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9 Jul 17 14:34:19 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3274ddb0-3d2f-4239-a429-2e41e4b67b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:19 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b 1073741824 Jul 17 14:34:19 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8cff56-0414-4ac9-b6c6-75865cb393e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:19 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 (d3b2c0fa-72fd-4fc0-8753-a40cefdad348): created successfully Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8cff56-0414-4ac9-b6c6-75865cb393e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (7ee217f2-a028-44f3-a384-d3412f97357b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-45bfbef5-792c-427d-bf89-2b2069e173ed tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:19 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309" returned: 0 in 0.519s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:19 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-af1bb149-eb8f-44b6-a6be-c251db02f3c9" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:19 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309 Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-af1bb149-eb8f-44b6-a6be-c251db02f3c9" released by "delete_volume" :: held 0.871s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:19 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['39d78795-595d-4548-bd14-399aaf42c17c', 'ffa7f908-193e-41bf-9c08-409b11965b8c', '2b86a0ec-561f-477d-924a-de591df47495', '6dd1d52f-00f2-4329-abd1-bc61a5093e54'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:19 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:19 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:19 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-83680c5f-8cff-474a-87d5-014a9ee44b4c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-c0189d81-37d7-4f44-94e0-c1fbe6e28309" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "cinder-quobyte-c0189d81-37d7-4f44-94e0-c1fbe6e28309" released by "delete_volume" :: held 0.946s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-83680c5f-8cff-474a-87d5-014a9ee44b4c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:19 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b 1073741824" returned: 0 in 0.724s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-83680c5f-8cff-474a-87d5-014a9ee44b4c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-83680c5f-8cff-474a-87d5-014a9ee44b4c" acquired by "delete_volume" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:20 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b Jul 17 14:34:20 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Created reservations ['15dec299-6580-40bd-9830-e78eba8f2077', '9bbdd88a-5b7b-4c56-b918-3c347d321b4a', '4d252d53-709b-4681-9e16-b0d1e3a6df26', '28b268c6-3b08-45bc-a82e-7a8a9e88ace1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[567cab6c-cf87-4800-bc91-25f7dd0b5662]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:20 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.405s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-61e2a4d4-4e3e-4623-90a6-416197457206 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-af1bb149-eb8f-44b6-a6be-c251db02f3c9-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:20 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:20 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:20 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c Jul 17 14:34:20 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:20 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b" returned: 0 in 0.367s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.884s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110277343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d0a8cd-16f4-4042-8a9b-298445733f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beccb8d6fcd49eb8e158fe596bb6e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:14Z,use_quota=True,user_id='8a91dff0142f4d038a0031bf35d6f327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Creating volume 77d0a8cd-16f4-4042-8a9b-298445733f94 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:20 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:20 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 1073741824 Jul 17 14:34:20 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73644d4-d2da-48eb-8823-9b57c8ecbade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f59da8-ab27-4e57-86e2-6affd7117f2b', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2f3f9f-5e2c-49df-b23b-15e1663afdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-60f59da8-ab27-4e57-86e2-6affd7117f2b (60f59da8-ab27-4e57-86e2-6affd7117f2b): created successfully Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2f3f9f-5e2c-49df-b23b-15e1663afdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (bac07a73-4748-4095-83c9-67f750465abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-94f31bb1-1991-46fa-8bd1-6bc3c8910b51 tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:20 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Deleted volume successfully. Jul 17 14:34:20 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c" returned: 0 in 0.477s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:20 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfde323c-2f5e-4639-bca3-2757e94765e2 tempest-VolumeAndVolumeTypeFromImageTest-1829200081 None] Lock "cinder-c0189d81-37d7-4f44-94e0-c1fbe6e28309-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:20 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:20 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-83680c5f-8cff-474a-87d5-014a9ee44b4c" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-83680c5f-8cff-474a-87d5-014a9ee44b4c" released by "delete_volume" :: held 0.821s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['aad64c01-3ba8-46c4-bc2c-61e483a5639b', '4fc891c6-5e72-4180-8698-5c5a677ae4f7', '45386bab-2560-4120-ab5e-c0443acba43b', '6d9f75e2-36bc-4aba-b861-76459f2de00a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:20 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 1073741824" returned: 0 in 0.498s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:21 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 Jul 17 14:34:21 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:21 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:21 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-05bb7d3e-58bb-4fca-ba77-027a090f42a6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-05bb7d3e-58bb-4fca-ba77-027a090f42a6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-05bb7d3e-58bb-4fca-ba77-027a090f42a6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-05bb7d3e-58bb-4fca-ba77-027a090f42a6" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:21 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96eeaf-94e6-4e8d-96a4-8801b9435510]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b3475fb-9cbb-47a1-a67e-98c6d6d8c006 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-83680c5f-8cff-474a-87d5-014a9ee44b4c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:21 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94" returned: 0 in 0.541s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c06b25-601b-42ec-a9c2-3463f1dad480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d0a8cd-16f4-4042-8a9b-298445733f94', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ce326a-3b33-4270-bca4-f6e25ffeeabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Volume volume-77d0a8cd-16f4-4042-8a9b-298445733f94 (77d0a8cd-16f4-4042-8a9b-298445733f94): created successfully Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ce326a-3b33-4270-bca4-f6e25ffeeabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Flow 'volume_create_manager' (dddc5818-cb53-4fe4-bcec-a0a8e8a51a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:21 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 Jul 17 14:34:21 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-34a0e86b-2541-4e35-b446-6b9ee59935a2 tempest-CreateVolumesFromSnapshotTest-553659393 None] Created volume successfully. Jul 17 14:34:21 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6" returned: 0 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:21 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6 Jul 17 14:34:21 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:22 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05bb7d3e-58bb-4fca-ba77-027a090f42a6" returned: 0 in 0.287s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-05bb7d3e-58bb-4fca-ba77-027a090f42a6" released by "delete_volume" :: held 0.810s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['a4bc6160-4166-4e4c-9edd-439a4b4f5712', '8bc12608-a089-4c5c-a862-67505a17b288', 'c9f323ab-a658-42cc-86a7-118c7b51b726', '6b676ac5-9c31-47b6-988b-cad49e62acef'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-77d0a8cd-16f4-4042-8a9b-298445733f94-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-77d0a8cd-16f4-4042-8a9b-298445733f94-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-77d0a8cd-16f4-4042-8a9b-298445733f94" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-77d0a8cd-16f4-4042-8a9b-298445733f94" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:22 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:22 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c80490b-209b-4d4d-8aa9-6678ed4c87f3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-7c525734-fcfb-416b-928c-f81d4c18dcd4-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-7c525734-fcfb-416b-928c-f81d4c18dcd4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-7c525734-fcfb-416b-928c-f81d4c18dcd4" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-7c525734-fcfb-416b-928c-f81d4c18dcd4" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:22 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 Jul 17 14:34:22 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f625fbd-ea14-4a4a-b973-4073afd752bc]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:22 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-180390a4-0a0c-40fd-8d8a-7db4ead65443 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-05bb7d3e-58bb-4fca-ba77-027a090f42a6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:22 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 Jul 17 14:34:22 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:23 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94" returned: 0 in 0.644s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:23 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94 Jul 17 14:34:23 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:23 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4" returned: 0 in 0.533s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:23 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4 Jul 17 14:34:23 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:23 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-77d0a8cd-16f4-4042-8a9b-298445733f94" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-77d0a8cd-16f4-4042-8a9b-298445733f94" released by "delete_volume" :: held 1.070s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['1ec61b39-087d-411e-8143-a42e387b72d8', 'b8e1a67e-55ae-4d2f-b39c-a1d93c5495c9', '3a610025-edea-4cb9-a3c3-81ce9e83cd0d', '455a0954-8c02-4d40-858b-89c3f79c7fa4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:23 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7c525734-fcfb-416b-928c-f81d4c18dcd4" returned: 0 in 0.526s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:23 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:23 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-7c525734-fcfb-416b-928c-f81d4c18dcd4" released by "delete_volume" :: held 1.143s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['ddbba2cd-011d-43f5-acbb-699fc75e931f', 'c07cae17-6373-44f2-9d31-12f4e4d74e46', '10cb7201-4834-4601-b6d0-d38af6f0d309', '57fb0463-61e7-4a1e-b7a5-d97fca8f864a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:24 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:24 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:24 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.338s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3909a8b3-ceb8-4b5b-8308-15119c36773e tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-77d0a8cd-16f4-4042-8a9b-298445733f94-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:24 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.360s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-38bd5f0d-2332-4ddb-8d1d-aad90c6e7dbc tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-7c525734-fcfb-416b-928c-f81d4c18dcd4-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Flow 'volume_create_manager' (cd71c3c8-24f9-4618-aa01-6158a76a8051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5793455-2dab-4929-9f86-437503e53b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5793455-2dab-4929-9f86-437503e53b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d320cce5-0e44-4e4c-8d5b-b055ee27ba43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63abdc6c3f34495ca37486eae9a95a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:24Z,use_quota=True,user_id='7a50798a1c0c4c3ab13b7e9b4d245633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d93edba-8980-4d57-b9cf-d2560ffa471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d93edba-8980-4d57-b9cf-d2560ffa471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbf0326-9237-4bfd-8a85-8ed2239ac10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.image.glance [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Creating Keystone auth plugin from conf {{(pid=87804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-60f59da8-ab27-4e57-86e2-6affd7117f2b-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-60f59da8-ab27-4e57-86e2-6affd7117f2b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-60f59da8-ab27-4e57-86e2-6affd7117f2b" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-60f59da8-ab27-4e57-86e2-6affd7117f2b" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8860e10e-de7a-41be-8976-f509a81d69b8]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "cinder-quobyte-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:25 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a3cf33-4f2f-44c8-9379-b6075403843e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:25 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbf0326-9237-4bfd-8a85-8ed2239ac10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd320cce5-0e44-4e4c-8d5b-b055ee27ba43', 'volume_name': 'volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43', 'volume_size': 1, 'image_id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3ab4f663b08f542c9433e9daa9d702c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63abdc6c3f34495ca37486eae9a95a95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '682432e3c97a1f0610c4bbe55b1c987ae0859cace44833f78b20d169bf5fee3e8a4d1333987873524b1af3bec6e7f8d1759b5eb493b8bf4f260bb67df470e591', 'id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54282348-87c7-41b2-8138-ac01047f86d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54282348-87c7-41b2-8138-ac01047f86d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ee162e-3d38-43ad-b99d-27e63f1f0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:25 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43', 'volume_size': 1, 'image_id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3ab4f663b08f542c9433e9daa9d702c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63abdc6c3f34495ca37486eae9a95a95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '682432e3c97a1f0610c4bbe55b1c987ae0859cace44833f78b20d169bf5fee3e8a4d1333987873524b1af3bec6e7f8d1759b5eb493b8bf4f260bb67df470e591', 'id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6/file', 'properties': {}}, 'image_service': } Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Trying to clone d320cce5-0e44-4e4c-8d5b-b055ee27ba43 from image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}]). {{(pid=87804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 14:34:25 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f Jul 17 14:34:25 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 14:34:25 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Image download 0.00 MB at 0.00 MB/s Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4900d94-0dcc-4d64-87e9-8f680e65658c]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b" returned: 0 in 0.466s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b Jul 17 14:34:25 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:25 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" returned: 0 in 0.448s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f Jul 17 14:34:25 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-60f59da8-ab27-4e57-86e2-6affd7117f2b" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-60f59da8-ab27-4e57-86e2-6affd7117f2b" released by "delete_volume" :: held 0.837s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:25 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['2cf81a34-39cc-49fd-85c1-4feac7295c43', '90dbb9f2-d856-4916-8fca-ec641b0045dc', '4769185c-6006-46ae-9399-b3195a9363dd', '5b1dc8e6-6949-4f33-a418-d211b8e1fcb4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:25 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" returned: 0 in 0.336s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:25 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:25 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:25 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-quobyte-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f" released by "delete_volume" :: held 0.872s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:25 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:25 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:25 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Created reservations ['7c10a4f8-7cda-4a1e-be27-dd4bf2a98864', '30355d97-60d2-4b94-9152-d92561fac814', '4f524e41-75b0-44f2-8829-5cfd8b111a03', '357b21f8-4c9b-4307-8aef-67068c661ceb'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-d3b2c0fa-72fd-4fc0-8753-a40cefdad348-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-d3b2c0fa-72fd-4fc0-8753-a40cefdad348-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" acquired by "delete_volume" :: waited 0.053s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:26 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:26 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f15a9c-ccf0-4692-a86e-20253b474cf5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:26 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 1 in 0.693s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Temporary image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 is fetched for user 7a50798a1c0c4c3ab13b7e9b4d245633. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.607s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:34:26 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.581s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[709875b8-d6f3-46d9-9af6-25281ef7e9ac]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e2419b35-400d-4088-bd0a-ca0707007cdb tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-60f59da8-ab27-4e57-86e2-6affd7117f2b-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:26 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 Jul 17 14:34:26 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:26 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:26 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:26 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.490s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Deleted volume successfully. Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56f55d53-72fb-4ae1-ac8e-eec5447b2a74 tempest-CreateVolumesFromSourceVolumeTest-936554814 None] Lock "cinder-6c8961b7-6cf5-4296-9a6a-0ac0b39c623f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:26 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" returned: 0 in 0.530s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:26 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348 Jul 17 14:34:26 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:26 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:27 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:27 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:27 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-d3b2c0fa-72fd-4fc0-8753-a40cefdad348" released by "delete_volume" :: held 0.887s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['cc7ec647-610b-4001-9953-6aeedef75911', 'f3c9512e-9fa0-46c6-80bf-86e1dcd9896c', 'cdeee6b3-cafa-4312-ae7b-9cf62541c977', '5a360e98-5e4f-4a3a-a034-ee671d8c1819'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:27 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d320cce5-0e44-4e4c-8d5b-b055ee27ba43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63abdc6c3f34495ca37486eae9a95a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:24Z,use_quota=True,user_id='7a50798a1c0c4c3ab13b7e9b4d245633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Creating volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:27 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:27 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1073741824 Jul 17 14:34:27 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:27 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:27 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:27 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Flow 'volume_create_manager' (388abccc-2624-4914-a27e-2854341fd093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9a3742-f059-4258-a0fc-029a4bcaa362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9a3742-f059-4258-a0fc-029a4bcaa362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-235563984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c1a426-2e49-46fc-9aba-1d1aab837ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2d5f848f7745309a515a914b162dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:28Z,use_quota=True,user_id='7b1233618afc45cfaa8ff092526de47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12365e7a-638e-4620-b70a-435b08d6741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12365e7a-638e-4620-b70a-435b08d6741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2efee-9d22-40a8-8039-eeaff7d2c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2efee-9d22-40a8-8039-eeaff7d2c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c1a426-2e49-46fc-9aba-1d1aab837ff4', 'volume_name': 'volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef8659b-75a3-44af-b2dc-7e650d13c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef8659b-75a3-44af-b2dc-7e650d13c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd65fa-53cc-4fce-8125-dca77de0e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Volume 61c1a426-2e49-46fc-9aba-1d1aab837ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4', 'volume_size': 1} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-42ef1856-2b33-47d9-9303-88ed80b0dc54 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-d3b2c0fa-72fd-4fc0-8753-a40cefdad348-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:27 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1073741824" returned: 0 in 0.608s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:27 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 Jul 17 14:34:27 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:28 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" returned: 0 in 0.267s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-235563984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c1a426-2e49-46fc-9aba-1d1aab837ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2d5f848f7745309a515a914b162dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:28Z,use_quota=True,user_id='7b1233618afc45cfaa8ff092526de47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Creating volume 61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:28 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:28 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 1073741824 Jul 17 14:34:28 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Attempting download of b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}])) to volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bb9e2c-a394-48a4-a05c-c9499879e901]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-2d7ca095-bfb9-4cf7-9783-20739de2c03d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-2d7ca095-bfb9-4cf7-9783-20739de2c03d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:28 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25 Jul 17 14:34:28 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-2d7ca095-bfb9-4cf7-9783-20739de2c03d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-2d7ca095-bfb9-4cf7-9783-20739de2c03d" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e27b4-e426-4623-81be-71782d1412fb]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:28 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d Jul 17 14:34:28 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:28 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 1073741824" returned: 0 in 0.614s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:28 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25" returned: 0 in 0.531s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:28 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:28 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25 Jul 17 14:34:29 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d" returned: 0 in 0.510s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:29 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d Jul 17 14:34:29 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.319s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd65fa-53cc-4fce-8125-dca77de0e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60789881-7090-4fa9-8309-7c55b47d5355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:29 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25" returned: 1 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_dz37my25' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d6d63-dafa-4787-a40e-0510cb0225d7]: (4, 'raw') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:29 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Volume volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 (61c1a426-2e49-46fc-9aba-1d1aab837ff4): created successfully Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60789881-7090-4fa9-8309-7c55b47d5355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Flow 'volume_create_manager' (388abccc-2624-4914-a27e-2854341fd093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7e1f0def-1c56-435d-9420-94d0f4d0543b tempest-VolumeDependencyTests-64509447 None] Created volume successfully. Jul 17 14:34:29 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:29 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2d7ca095-bfb9-4cf7-9783-20739de2c03d" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-2d7ca095-bfb9-4cf7-9783-20739de2c03d" released by "delete_volume" :: held 0.853s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['13fd6815-a3e4-413b-9829-058b76e0778a', '41a69e11-bf4e-4d0b-b870-662dcb3c1237', '66ec10ce-9924-4eb8-80ae-d41c89d43b5a', 'cad6d2a3-882b-42b1-9668-7909ed55ff6b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:29 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:29 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-2ebae69a-2810-4686-b3aa-6da6f4f50603-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-2ebae69a-2810-4686-b3aa-6da6f4f50603-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-2ebae69a-2810-4686-b3aa-6da6f4f50603" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-2ebae69a-2810-4686-b3aa-6da6f4f50603" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:29 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD Jul 17 14:34:29 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e3552-ef07-474e-97b1-a854bb883703]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.481s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 Jul 17 14:34:30 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-62a52f35-274b-43ab-9ac9-492cafa7adab tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-2d7ca095-bfb9-4cf7-9783-20739de2c03d-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Creating offline snapshot f02719a8-2cfb-4483-a72f-fa2817b8c61a of volume 61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5622cc-a705-4a96-8596-404963f0dfaa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD" returned: 1 in 0.526s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 was raw, converting to qcow2 {{(pid=87804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 Jul 17 14:34:30 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:30 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603" returned: 0 in 0.536s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603 Jul 17 14:34:30 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a 1G Jul 17 14:34:30 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-2ebae69a-2810-4686-b3aa-6da6f4f50603" returned: 0 in 0.322s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-2ebae69a-2810-4686-b3aa-6da6f4f50603" released by "delete_volume" :: held 0.911s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:30 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" returned: 0 in 0.612s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6_31z9r47pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:34:30 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['890401a1-fc6e-4b49-8ca2-51f464ccfde8', '90134154-b4e9-4e37-aa9f-f7b141395d99', '4d96a923-2fa8-4b8f-94b5-a41be80a425f', 'bf213431-2226-4b72-99b5-23a2e6179b19'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:30 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1G Jul 17 14:34:30 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:31 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:31 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Flow 'volume_create_manager' (e76b1723-ba84-47f8-a3dc-90791eb7c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b96388-cc03-40c8-ad9e-2c0d9c2e5ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b96388-cc03-40c8-ad9e-2c0d9c2e5ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0eea67-f384-441f-8298-2ac296a14801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec5346073754d6892ddadc73efabf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:31Z,use_quota=True,user_id='36d567a49d924ab1948da41d40fb4649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cb1234-863e-4872-8c1d-520f57c2bc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cb1234-863e-4872-8c1d-520f57c2bc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742479d7-e9e3-44d8-9899-73f0a2f4e279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742479d7-e9e3-44d8-9899-73f0a2f4e279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0eea67-f384-441f-8298-2ac296a14801', 'volume_name': 'volume-ef0eea67-f384-441f-8298-2ac296a14801', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9b02b7-7f89-4386-9e66-4a6dfd41caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9b02b7-7f89-4386-9e66-4a6dfd41caf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2271742e-176b-46ee-b829-83f1d109a30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Volume ef0eea67-f384-441f-8298-2ac296a14801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0eea67-f384-441f-8298-2ac296a14801', 'volume_size': 1} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a 1G" returned: 0 in 0.617s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:31 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 1G" returned: 0 in 0.412s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Downloaded image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}])) to volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43 successfully. {{(pid=87804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Temporary image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 for user 7a50798a1c0c4c3ab13b7e9b4d245633 is deleted. {{(pid=87804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.volume_utils [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Marking volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43 as bootable. {{(pid=87804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 14:34:31 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:31 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Copying metadata from image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 to d320cce5-0e44-4e4c-8d5b-b055ee27ba43. {{(pid=87804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Creating volume glance metadata for volume d320cce5-0e44-4e4c-8d5b-b055ee27ba43 backed by image b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6 with: {'image_id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c3ab4f663b08f542c9433e9daa9d702c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 14:34:31 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ee162e-3d38-43ad-b99d-27e63f1f0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43', 'volume_size': 1, 'image_id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3ab4f663b08f542c9433e9daa9d702c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63abdc6c3f34495ca37486eae9a95a95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '682432e3c97a1f0610c4bbe55b1c987ae0859cace44833f78b20d169bf5fee3e8a4d1333987873524b1af3bec6e7f8d1759b5eb493b8bf4f260bb67df470e591', 'id': 'b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6', 'created_at': datetime.datetime(2026, 7, 17, 12, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 12, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8c9ffdd-59c6-48fa-8b77-2bcbac68e3c6/file', 'properties': {}}, 'image_service': }' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1649bfe3-fea9-491d-8441-21ce4f92d6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-f0c2551c-6541-4f1e-b645-1a8dae388a39 tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-2ebae69a-2810-4686-b3aa-6da6f4f50603-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Volume volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 (d320cce5-0e44-4e4c-8d5b-b055ee27ba43): created successfully Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1649bfe3-fea9-491d-8441-21ce4f92d6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Flow 'volume_create_manager' (cd71c3c8-24f9-4618-aa01-6158a76a8051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-35109ad4-b785-4d4d-844c-16ef26d04fc2 tempest-VolumeImageDependencyTests-150477849 None] Created volume successfully. Jul 17 14:34:31 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.320s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:31 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a is being set with open permissions: ugo+rw Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:31 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:31 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:31 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.233s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:31 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info Jul 17 14:34:31 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleting offline snapshot 9df23a94-b967-4bc1-93ca-5e8b3ac68fcc of volume feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] snapshot_file for this snap is: volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:34:32 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info" returned: 0 in 0.297s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:32 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info is being set with open permissions: ugo+rw Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[97489599-8e29-40b6-8f60-2cfd40f7a92a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info Jul 17 14:34:32 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Acquiring lock "cinder-d320cce5-0e44-4e4c-8d5b-b055ee27ba43-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "cinder-d320cce5-0e44-4e4c-8d5b-b055ee27ba43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:32 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc Jul 17 14:34:32 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Acquiring lock "cinder-quobyte-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "cinder-quobyte-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dc289d-5b94-4cea-a720-31bb457cbe9f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.info" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0eea67-f384-441f-8298-2ac296a14801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec5346073754d6892ddadc73efabf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:31Z,use_quota=True,user_id='36d567a49d924ab1948da41d40fb4649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Creating volume ef0eea67-f384-441f-8298-2ac296a14801 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:32 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 Jul 17 14:34:32 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 1073741824 Jul 17 14:34:32 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-476b16b6-71b1-4937-abf1-472605ca7a30 tempest-VolumeDependencyTests-64509447 None] Create snapshot completed successfully Jul 17 14:34:32 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feec17c5-609b-4746-a454-66ee765fe3fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09cc2a8-3015-47bb-a9db-a60f9e93c5a3]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb Jul 17 14:34:32 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" returned: 0 in 0.456s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:32 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43 Jul 17 14:34:32 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:32 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 1073741824" returned: 0 in 0.521s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:33 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 Jul 17 14:34:33 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:33 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "cinder-quobyte-d320cce5-0e44-4e4c-8d5b-b055ee27ba43" released by "delete_volume" :: held 0.781s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:33 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb" returned: 0 in 0.505s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:33 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc Jul 17 14:34:33 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Created reservations ['521afb42-1201-46dd-9e53-38caaaa26ec3', '5abe8d07-1fee-424a-a486-81c516d41904', '095d89aa-7037-45c3-a433-2438aa38a411', '9efd63a9-2a2d-4b91-87fb-07b6b207606e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:33 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:33 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:33 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801" returned: 0 in 0.299s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2271742e-176b-46ee-b829-83f1d109a30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0eea67-f384-441f-8298-2ac296a14801', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7163f779-f37b-4102-b009-17e14252eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:33 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Volume volume-ef0eea67-f384-441f-8298-2ac296a14801 (ef0eea67-f384-441f-8298-2ac296a14801): created successfully Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7163f779-f37b-4102-b009-17e14252eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Flow 'volume_create_manager' (e76b1723-ba84-47f8-a3dc-90791eb7c644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f4367783-717c-4687-a92b-fe03f4a51574 tempest-CinderUnicodeTest-1953838376 None] Created volume successfully. Jul 17 14:34:33 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" returned: 0 in 0.454s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:33 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:33 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc Jul 17 14:34:33 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Deleted volume successfully. Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6f177648-3bb9-42e1-b342-edfb49d9e752 tempest-VolumeImageDependencyTests-150477849 None] Lock "cinder-d320cce5-0e44-4e4c-8d5b-b055ee27ba43-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:33 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb.9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" returned: 0 in 0.316s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc" released by "_delete_snapshot" :: held 1.879s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" released by "delete_snapshot" :: held 1.912s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:33 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Flow 'volume_create_manager' (7a8545dc-15af-4f2c-b196-a26611a84991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c7cca3-c917-465b-8953-b4764958daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c7cca3-c917-465b-8953-b4764958daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1161974137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35222d27-81a2-4d79-8146-b31777801970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2d5f848f7745309a515a914b162dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f02719a8-2cfb-4483-a72f-fa2817b8c61a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:34Z,use_quota=True,user_id='7b1233618afc45cfaa8ff092526de47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399ef046-54a6-4ab3-9fab-a52010dcd008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399ef046-54a6-4ab3-9fab-a52010dcd008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acda83f-32d9-4716-a81a-466010f55070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acda83f-32d9-4716-a81a-466010f55070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35222d27-81a2-4d79-8146-b31777801970', 'volume_name': 'volume-35222d27-81a2-4d79-8146-b31777801970', 'volume_size': 1, 'snapshot_id': 'f02719a8-2cfb-4483-a72f-fa2817b8c61a'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f07b253-4e16-4e06-8f98-7eabfbb07628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f07b253-4e16-4e06-8f98-7eabfbb07628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217ac674-aa4b-4f85-89e3-cd66c3e1cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:34 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Volume 35222d27-81a2-4d79-8146-b31777801970: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35222d27-81a2-4d79-8146-b31777801970', 'volume_size': 1, 'snapshot_id': 'f02719a8-2cfb-4483-a72f-fa2817b8c61a'} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a-35222d27-81a2-4d79-8146-b31777801970" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['0358f1b5-640d-4bff-b59b-a41420b65277', 'd689a7dd-2e73-42d1-b0d4-c5d4ea8ef695', '56c04055-e4c1-4514-85aa-5334eee4a867', '0f93c9e1-9e40-4457-94e3-0f872774eaf4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a-35222d27-81a2-4d79-8146-b31777801970" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Creating volume 35222d27-81a2-4d79-8146-b31777801970 from snapshot f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] snapshot: f02719a8-2cfb-4483-a72f-fa2817b8c61a, volume: 35222d27-81a2-4d79-8146-b31777801970, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[023eb540-5b98-4d1a-a304-76ec58a0753d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Delete snapshot completed successfully. Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d66569e2-48b9-4816-b66f-3efc11c4839a tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-9df23a94-b967-4bc1-93ca-5e8b3ac68fcc-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:34 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:34 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:34 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb13429-7b2d-4bb6-aaa3-d4fbd3e21357]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:34 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:34 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Flow 'volume_create_manager' (aca157e9-5879-4888-bc95-dd172731a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2515c154-d710-4705-9bf7-30d77a6e7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2515c154-d710-4705-9bf7-30d77a6e7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-793137092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c891a9a-8040-4eb9-a24f-c9e24eedc523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec5346073754d6892ddadc73efabf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:35Z,use_quota=True,user_id='36d567a49d924ab1948da41d40fb4649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3edc7-fc52-4259-893c-337cd44f9441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3edc7-fc52-4259-893c-337cd44f9441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea77eed-ca7d-411c-b4d8-d18f891c3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea77eed-ca7d-411c-b4d8-d18f891c3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c891a9a-8040-4eb9-a24f-c9e24eedc523', 'volume_name': 'volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfcba99-7127-4a3b-a0c2-545b5123fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:35 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfcba99-7127-4a3b-a0c2-545b5123fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4defdf5e-b936-4df5-a481-bbbc3f362b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:35 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Volume 0c891a9a-8040-4eb9-a24f-c9e24eedc523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523', 'volume_size': 1} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.425s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:35 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 Jul 17 14:34:35 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-feec17c5-609b-4746-a454-66ee765fe3fb-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-feec17c5-609b-4746-a454-66ee765fe3fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b516cd58-5df7-412a-bd18-839ca5c560db]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:35 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb Jul 17 14:34:35 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:35 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb" returned: 0 in 0.534s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:35 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:36 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb Jul 17 14:34:36 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:36 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-feec17c5-609b-4746-a454-66ee765fe3fb" returned: 0 in 0.598s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-quobyte-feec17c5-609b-4746-a454-66ee765fe3fb" released by "delete_volume" :: held 1.219s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Created reservations ['9df0fc0e-09f7-4071-b828-077fd292b08e', '810f71fb-7c01-42c2-a8c3-8e7a35553b70', 'f37e9ed8-e9ee-4f3e-819f-00bb9f17df54', 'dcbd49bd-163f-4f4b-8c55-98c237e3949b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:37 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:37 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:37 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.452s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:37 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Deleted volume successfully. Jul 17 14:34:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c0c1d9dd-9363-4471-857e-a1a53eb2b70c tempest-CreateVolumesFromSnapshotTest-553659393 None] Lock "cinder-feec17c5-609b-4746-a454-66ee765fe3fb-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:40 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970" returned: 0 in 5.728s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:40 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d86e7b-075c-406c-876c-d8ffff1deb12]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:41 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:41 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:41 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.644s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:34:41 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Converted 1024.00 MB image at 178.75 MB/s Jul 17 14:34:41 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 is being set with open permissions: ugo+rw Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:41 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 Jul 17 14:34:41 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (bdda9d3f-76ee-483f-bd12-c3dd3884fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f68ab8c-fb9a-481e-8978-1142333e59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f68ab8c-fb9a-481e-8978-1142333e59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910614081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b687159-ccd8-4105-ae66-8ed759d56195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:42Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c780d-fd7a-4f50-9c54-f8f2f1d9dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c780d-fd7a-4f50-9c54-f8f2f1d9dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4db4e9-8f25-4c02-8d61-e9c71668659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4db4e9-8f25-4c02-8d61-e9c71668659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b687159-ccd8-4105-ae66-8ed759d56195', 'volume_name': 'volume-0b687159-ccd8-4105-ae66-8ed759d56195', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d024d71-e7bc-481b-b11e-df43da53e21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d024d71-e7bc-481b-b11e-df43da53e21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b06ec6-1798-4389-b5a8-0058764bb74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Volume 0b687159-ccd8-4105-ae66-8ed759d56195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b687159-ccd8-4105-ae66-8ed759d56195', 'volume_size': 1} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:41 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" released by "_copy_volume_from_snapshot" :: held 7.658s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a-35222d27-81a2-4d79-8146-b31777801970" released by "_create_volume_from_snapshot" :: held 7.706s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.735s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.703s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-793137092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c891a9a-8040-4eb9-a24f-c9e24eedc523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec5346073754d6892ddadc73efabf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:35Z,use_quota=True,user_id='36d567a49d924ab1948da41d40fb4649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Creating volume 0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:41 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:41 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 1073741824 Jul 17 14:34:41 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217ac674-aa4b-4f85-89e3-cd66c3e1cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35222d27-81a2-4d79-8146-b31777801970', 'volume_size': 1, 'snapshot_id': 'f02719a8-2cfb-4483-a72f-fa2817b8c61a'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd71252-e3e9-4c07-9dbb-1d63e6589f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:41 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Volume volume-35222d27-81a2-4d79-8146-b31777801970 (35222d27-81a2-4d79-8146-b31777801970): created successfully Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd71252-e3e9-4c07-9dbb-1d63e6589f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:41 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Flow 'volume_create_manager' (7a8545dc-15af-4f2c-b196-a26611a84991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:41 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d97dcae7-dcb6-4165-a845-6807f30596c7 tempest-VolumeDependencyTests-64509447 None] Created volume successfully. Jul 17 14:34:42 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 1073741824" returned: 0 in 0.508s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:42 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 Jul 17 14:34:42 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:42 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523" returned: 0 in 0.277s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910614081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b687159-ccd8-4105-ae66-8ed759d56195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:42Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Creating volume 0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:42 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4defdf5e-b936-4df5-a481-bbbc3f362b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:42 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 1073741824 Jul 17 14:34:42 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fb4457-6bb9-43bb-9c72-6eb20485d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:42 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Volume volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 (0c891a9a-8040-4eb9-a24f-c9e24eedc523): created successfully Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fb4457-6bb9-43bb-9c72-6eb20485d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:42 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Flow 'volume_create_manager' (aca157e9-5879-4888-bc95-dd172731a967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:42 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c2b3cf88-2ee1-4d36-a010-63b6d1ee64f7 tempest-CinderUnicodeTest-1953838376 None] Created volume successfully. Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-f02719a8-2cfb-4483-a72f-fa2817b8c61a-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-f02719a8-2cfb-4483-a72f-fa2817b8c61a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Deleting offline snapshot f02719a8-2cfb-4483-a72f-fa2817b8c61a of volume 61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] snapshot_file for this snap is: volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-edf66243-1f2a-4ae1-a33d-d5576be59e3e tempest-ProjectAdminTests-363966680 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6747207641602, 'free_capacity_gb': 1775.6747207641602, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87804) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb12911d-2fbd-47cf-87b5-9e8daf7a4066]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:43 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 1073741824" returned: 0 in 0.586s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:43 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:43 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:43 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 Jul 17 14:34:43 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:43 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:43 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.512s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195" returned: 0 in 0.376s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.072s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3285b-5e30-4f38-b6e2-5d0592f47559]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b06ec6-1798-4389-b5a8-0058764bb74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b687159-ccd8-4105-ae66-8ed759d56195', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856e47ed-2b84-4831-9e11-acfc5f21cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Creating offline snapshot 7fb7f758-0dba-491e-8f94-28239a761e2a of volume 0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:34:43 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Volume volume-0b687159-ccd8-4105-ae66-8ed759d56195 (0b687159-ccd8-4105-ae66-8ed759d56195): created successfully Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856e47ed-2b84-4831-9e11-acfc5f21cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (bdda9d3f-76ee-483f-bd12-c3dd3884fece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fd7e75-38d8-479f-883a-cdc49c9afe90]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:43 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0395b914-f6e8-4268-a1b3-45c41eb30cdf tempest-ProjectReaderTests-1050265301 None] Created volume successfully. Jul 17 14:34:43 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:43 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:43 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 Jul 17 14:34:43 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:44 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.411s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:44 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:44 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:44 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:44 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a 1G Jul 17 14:34:44 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:44 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.449s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:44 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a Jul 17 14:34:44 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:44 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a 1G" returned: 0 in 0.511s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:44 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a Jul 17 14:34:44 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:44 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4.f02719a8-2cfb-4483-a72f-fa2817b8c61a" returned: 0 in 0.339s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-f02719a8-2cfb-4483-a72f-fa2817b8c61a" released by "_delete_snapshot" :: held 1.871s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:44 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" released by "delete_snapshot" :: held 1.909s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Created reservations ['67cb46ed-3983-47a8-9ac1-776500c35837', 'e4f34739-efc1-42b4-a0b3-6381b78e2c8b', 'ae82c2a5-c2a7-42db-8d8a-a9318aec891f', '475a5758-384a-4382-8c18-dea491312929'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:45 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a" returned: 0 in 0.427s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:45 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a is being set with open permissions: ugo+rw Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:45 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a Jul 17 14:34:45 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:45 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Delete snapshot completed successfully. Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-943d0b5f-d404-4804-9784-e9af242fee14 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-f02719a8-2cfb-4483-a72f-fa2817b8c61a-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-61c1a426-2e49-46fc-9aba-1d1aab837ff4-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "cinder-61c1a426-2e49-46fc-9aba-1d1aab837ff4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[57694c7c-2cf0-417c-9547-2d7b6fb657be]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:45 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a" returned: 0 in 0.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:45 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info Jul 17 14:34:45 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:45 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:45 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:45 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info" returned: 0 in 0.291s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:45 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info is being set with open permissions: ugo+rw Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:45 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info Jul 17 14:34:45 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:45 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.445s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:45 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4 Jul 17 14:34:45 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:46 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.info" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.075s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Creating offline snapshot 28791e12-9473-470e-9522-a26c7ffb17fb of volume 0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:34:46 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-61c1a426-2e49-46fc-9aba-1d1aab837ff4" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc94ccb-9d86-4560-8c03-7b1a8880b555]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8fceeb0a-852a-49ac-9fe2-f8b60e82d16c tempest-CinderUnicodeTest-1953838376 None] Create snapshot completed successfully Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-61c1a426-2e49-46fc-9aba-1d1aab837ff4" released by "delete_volume" :: held 0.831s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Created reservations ['90220855-0938-4b8b-b1c4-55c88751b1d1', '151ee3fd-fa9a-41a8-8b67-1a05db11f851', 'd777d4b2-6295-4d60-be5d-aa63fba0a535', 'd4f81e15-bb8d-48e9-b98e-3892f3184769'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:46 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 Jul 17 14:34:46 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:46 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:46 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-35222d27-81a2-4d79-8146-b31777801970-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-35222d27-81a2-4d79-8146-b31777801970-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1814be16-8e5d-41fe-ab9c-088bd634073d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:46 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195" returned: 0 in 0.526s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:46 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb 1G Jul 17 14:34:46 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:46 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.423s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-7fb7f758-0dba-491e-8f94-28239a761e2a-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Deleted volume successfully. Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-7fb7f758-0dba-491e-8f94-28239a761e2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6499e465-86ab-40e6-9fdf-9a4130b29c7b tempest-VolumeDependencyTests-64509447 None] Lock "cinder-61c1a426-2e49-46fc-9aba-1d1aab837ff4-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-quobyte-7fb7f758-0dba-491e-8f94-28239a761e2a" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:46 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 Jul 17 14:34:46 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-7fb7f758-0dba-491e-8f94-28239a761e2a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Deleting offline snapshot 7fb7f758-0dba-491e-8f94-28239a761e2a of volume 0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] snapshot_file for this snap is: volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7959d0e9-2271-4a44-a527-0fa069bca267]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a Jul 17 14:34:47 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:47 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970" returned: 0 in 0.583s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb 1G" returned: 0 in 0.584s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b687159-ccd8-4105-ae66-8ed759d56195 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970 Jul 17 14:34:47 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b687159-ccd8-4105-ae66-8ed759d56195 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb Jul 17 14:34:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:47 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a" returned: 0 in 0.464s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc1c48d-ed7b-4647-ba92-90cbd23fee88]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:47 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 Jul 17 14:34:47 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-35222d27-81a2-4d79-8146-b31777801970" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-quobyte-35222d27-81a2-4d79-8146-b31777801970" released by "delete_volume" :: held 0.971s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b687159-ccd8-4105-ae66-8ed759d56195 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:47 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb is being set with open permissions: ugo+rw Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Created reservations ['8d0e623c-7ae9-4d03-8bd7-35a9e0e4b2bd', '233e9523-3c4c-4331-a116-1ec9405689e7', '55443488-c2f9-4e9d-baf5-b676f1c17070', 'db6a6ebf-0f1b-4295-ad4e-b4533cde9cc4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:47 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb Jul 17 14:34:47 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:47 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:47 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:48 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523" returned: 0 in 0.553s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:48 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb" returned: 0 in 0.335s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a Jul 17 14:34:48 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:48 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info Jul 17 14:34:48 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:48 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.298s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Deleted volume successfully. Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b8d08ea8-2036-48a3-a564-fc9194013d68 tempest-VolumeDependencyTests-64509447 None] Lock "cinder-35222d27-81a2-4d79-8146-b31777801970-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:48 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info" returned: 0 in 0.305s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info is being set with open permissions: ugo+rw Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:48 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info Jul 17 14:34:48 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:48 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a" returned: 0 in 0.516s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:48 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a Jul 17 14:34:48 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:48 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.info" returned: 0 in 0.281s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-bf6d9323-0c20-4e8a-a24e-2b00278f2cb3 tempest-ProjectReaderTests-1050265301 None] Create snapshot completed successfully Jul 17 14:34:48 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523.7fb7f758-0dba-491e-8f94-28239a761e2a" returned: 0 in 0.305s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-7fb7f758-0dba-491e-8f94-28239a761e2a" released by "_delete_snapshot" :: held 1.974s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" released by "delete_snapshot" :: held 2.003s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:48 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Created reservations ['773672c2-d11f-4d65-ac79-c92ebc19694d', 'd8565d51-bdd5-49ff-99d5-6d881f938eb2', 'b98396ef-d56f-497b-a323-c9ea8bf3e76f', '292b1b4d-c3d1-4602-9c0b-488a16ef2ece'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:49 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Delete snapshot completed successfully. Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c4344bc3-f373-4502-b089-da397da0fbc3 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-7fb7f758-0dba-491e-8f94-28239a761e2a-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-28791e12-9473-470e-9522-a26c7ffb17fb-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-28791e12-9473-470e-9522-a26c7ffb17fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-28791e12-9473-470e-9522-a26c7ffb17fb" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-28791e12-9473-470e-9522-a26c7ffb17fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Deleting offline snapshot 28791e12-9473-470e-9522-a26c7ffb17fb of volume 0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] snapshot_file for this snap is: volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c305e61-feb3-406c-9b2c-7e6984359594]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:49 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb Jul 17 14:34:49 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-0c891a9a-8040-4eb9-a24f-c9e24eedc523-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-0c891a9a-8040-4eb9-a24f-c9e24eedc523-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:50 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb" returned: 0 in 0.520s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b687159-ccd8-4105-ae66-8ed759d56195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecfeb58-3c1c-4824-a884-7b7ec8b3d189]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6089af6e-ce90-40b8-8af1-b2d666b6a175]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:50 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 Jul 17 14:34:50 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:50 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 Jul 17 14:34:50 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:50 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:50 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195" returned: 0 in 0.458s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523" returned: 0 in 0.489s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:50 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb Jul 17 14:34:50 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:50 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523 Jul 17 14:34:50 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:51 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0c891a9a-8040-4eb9-a24f-c9e24eedc523" returned: 0 in 0.322s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-0c891a9a-8040-4eb9-a24f-c9e24eedc523" released by "delete_volume" :: held 0.922s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Created reservations ['f23e7232-b3ae-4a8e-8878-3e95b21563bb', '84f954ad-4933-4fd5-b5c4-6c99a2da8be2', 'ed568599-436c-49e6-a361-511e353cd251', 'f7000a83-508f-4b25-a563-487955fa8d39'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:51 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb" returned: 0 in 0.534s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:51 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb Jul 17 14:34:51 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:51 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:51 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195.28791e12-9473-470e-9522-a26c7ffb17fb" returned: 0 in 0.316s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-28791e12-9473-470e-9522-a26c7ffb17fb" released by "_delete_snapshot" :: held 1.967s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" released by "delete_snapshot" :: held 1.995s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:51 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.343s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Deleted volume successfully. Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-be439037-cce4-4098-b04d-3e5517d90fb1 tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-0c891a9a-8040-4eb9-a24f-c9e24eedc523-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Created reservations ['037cc6d0-d08c-4abc-8c90-9af73856d65a', 'f3cc45a4-0e93-4ed0-a1b7-9b65d54b2c9a', '8d7b6c0b-3fa7-4252-a855-f87ea6bc81de', 'b67d9a87-e86e-42fa-b908-95252be1402f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:51 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Delete snapshot completed successfully. Jul 17 14:34:51 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5356fafb-1431-405c-a5c7-2aefb3c30e3d tempest-ProjectReaderTests-1050265301 None] Lock "cinder-28791e12-9473-470e-9522-a26c7ffb17fb-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-ef0eea67-f384-441f-8298-2ac296a14801-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-ef0eea67-f384-441f-8298-2ac296a14801-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "cinder-quobyte-ef0eea67-f384-441f-8298-2ac296a14801" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-ef0eea67-f384-441f-8298-2ac296a14801" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d0dd0-80a2-4d0f-aab0-a3b899476122]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:52 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 Jul 17 14:34:52 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-0b687159-ccd8-4105-ae66-8ed759d56195-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:52 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-0b687159-ccd8-4105-ae66-8ed759d56195-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=255,cinder:SELECT=213,cinder:INSERT=68,cinder:DELETE=29 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:34:53 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801" returned: 0 in 0.536s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8369d-4943-4f7a-a4ac-d2f84361e626]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:53 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801 Jul 17 14:34:53 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:53 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 Jul 17 14:34:53 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:53 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ef0eea67-f384-441f-8298-2ac296a14801" returned: 0 in 0.329s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-quobyte-ef0eea67-f384-441f-8298-2ac296a14801" released by "delete_volume" :: held 0.995s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=200,cinder:UPDATE=303,cinder:DELETE=21,cinder:INSERT=82 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Created reservations ['394dbf8a-0526-4781-911a-125767b87c47', '47f93450-44dd-4b9f-a18e-e7c4fc84f1b2', '8786e758-d0b1-4e73-859d-461df3eb5a3f', 'bb938b7b-7161-4501-81e0-043b9ad6ca18'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:53 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195" returned: 0 in 0.568s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:53 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195 Jul 17 14:34:53 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:53 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:53 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:54 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-0b687159-ccd8-4105-ae66-8ed759d56195" returned: 0 in 0.368s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:54 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.353s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-0b687159-ccd8-4105-ae66-8ed759d56195" released by "delete_volume" :: held 1.032s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Deleted volume successfully. Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-29552d95-3a9d-40c6-8347-dab1854bdf0e tempest-CinderUnicodeTest-1953838376 None] Lock "cinder-ef0eea67-f384-441f-8298-2ac296a14801-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Created reservations ['5cb15fc3-0da5-41eb-b1ce-4ecc57431ab3', '82ace0e3-4590-46b6-a34e-ffd1bb314c6f', '0577275c-a11e-4e48-bc8e-dda6f7b2677f', 'd44bdd00-738a-4793-9b9e-38d8eded7821'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:54 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:34:54 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:54 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.300s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:34:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Deleted volume successfully. Jul 17 14:34:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b7d6652-167c-44a5-a05e-d4bbe68f9311 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-0b687159-ccd8-4105-ae66-8ed759d56195-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:34:55 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (41a0a7ea-c5f9-48dd-a7fa-d0cb6278f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d18420-c28b-48a7-8637-8593c49718b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d18420-c28b-48a7-8637-8593c49718b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821858421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05125052-75a2-4008-9fee-611ca7ea52ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:56Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8081690c-c018-4efd-ad93-fa6ee1f4315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8081690c-c018-4efd-ad93-fa6ee1f4315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712e7901-8cd7-498d-9776-69edc8aa8bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712e7901-8cd7-498d-9776-69edc8aa8bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05125052-75a2-4008-9fee-611ca7ea52ec', 'volume_name': 'volume-05125052-75a2-4008-9fee-611ca7ea52ec', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e16a420-4d7d-44f2-aeaa-3154281d030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e16a420-4d7d-44f2-aeaa-3154281d030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5e8ba-48e3-4079-9fd7-ed6ff6e34f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:56 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Volume 05125052-75a2-4008-9fee-611ca7ea52ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05125052-75a2-4008-9fee-611ca7ea52ec', 'volume_size': 1} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821858421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05125052-75a2-4008-9fee-611ca7ea52ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:34:56Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Creating volume 05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:34:56 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:56 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec 1073741824 Jul 17 14:34:56 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:56 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec 1073741824" returned: 0 in 0.632s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:56 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec Jul 17 14:34:56 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:57 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec" returned: 0 in 0.331s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5e8ba-48e3-4079-9fd7-ed6ff6e34f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05125052-75a2-4008-9fee-611ca7ea52ec', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9e57c-02bd-4711-8fe4-164971e9bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:57 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Volume volume-05125052-75a2-4008-9fee-611ca7ea52ec (05125052-75a2-4008-9fee-611ca7ea52ec): created successfully Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9e57c-02bd-4711-8fe4-164971e9bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:57 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (41a0a7ea-c5f9-48dd-a7fa-d0cb6278f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-1a2f6148-e24d-4504-92c9-083b9752f871 tempest-ProjectReaderTests-1050265301 None] Created volume successfully. Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Creating offline snapshot 17d81859-33de-49f9-b226-c517db7f481c of volume 05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9ded34-dbb2-4db1-8754-848ccfab15f7]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:58 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec Jul 17 14:34:58 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:58 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec" returned: 0 in 0.506s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:58 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c 1G Jul 17 14:34:58 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:59 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c 1G" returned: 0 in 0.557s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05125052-75a2-4008-9fee-611ca7ea52ec -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:59 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05125052-75a2-4008-9fee-611ca7ea52ec -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c Jul 17 14:34:59 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (79bf0cc5-2475-4593-9509-8fb01a28e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:34:59 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47dee86-2f79-4468-bb50-801ee80889d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05125052-75a2-4008-9fee-611ca7ea52ec -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c" returned: 0 in 0.475s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:34:59 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c is being set with open permissions: ugo+rw Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:34:59 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47dee86-2f79-4468-bb50-801ee80889d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-196041033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b722f5d-9671-49ce-a792-4ada30a40b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:00Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:59 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c391d6-becd-4f29-95bf-012ca89a0f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c391d6-becd-4f29-95bf-012ca89a0f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:34:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848ed7fd-0b99-413c-b0bd-1344d0fb84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848ed7fd-0b99-413c-b0bd-1344d0fb84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b722f5d-9671-49ce-a792-4ada30a40b1d', 'volume_name': 'volume-7b722f5d-9671-49ce-a792-4ada30a40b1d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbf1dc5-b9ad-452f-9537-e0f190aaf75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbf1dc5-b9ad-452f-9537-e0f190aaf75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9dae35-b754-4851-807c-a2c600e58e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Volume 7b722f5d-9671-49ce-a792-4ada30a40b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b722f5d-9671-49ce-a792-4ada30a40b1d', 'volume_size': 1} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:00 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c" returned: 0 in 0.309s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:00 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info Jul 17 14:35:00 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Flow 'volume_create_manager' (87cfe961-4b78-4b53-899a-e64ce91bdecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74348925-a1d6-4a64-afd6-1a074f678610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74348925-a1d6-4a64-afd6-1a074f678610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685867368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf668bcd664e42cebd1641ea111a25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:00Z,use_quota=True,user_id='ad2071ec71054aaa98e1fcf8ba0503b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9472db36-b060-436f-a43f-2bacf28550d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9472db36-b060-436f-a43f-2bacf28550d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ce122f-8341-433e-bf66-9ed4dd7b7780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ce122f-8341-433e-bf66-9ed4dd7b7780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6', 'volume_name': 'volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84655072-6a69-4ea8-bb26-5ed27e3f80ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84655072-6a69-4ea8-bb26-5ed27e3f80ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a62043b-9dd8-4fd0-b906-f16c8f2ab998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:00 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Volume 4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6', 'volume_size': 1} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:00 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:00 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info is being set with open permissions: ugo+rw Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:00 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info Jul 17 14:35:00 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:00 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.info" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-196041033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b722f5d-9671-49ce-a792-4ada30a40b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:00Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Creating volume 7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:00 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:00 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d 1073741824 Jul 17 14:35:00 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-12f660b3-95f9-4cc9-b6ab-bfd1854c1414 tempest-ProjectReaderTests-1050265301 None] Create snapshot completed successfully Jul 17 14:35:01 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d 1073741824" returned: 0 in 0.544s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:01 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d Jul 17 14:35:01 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-17d81859-33de-49f9-b226-c517db7f481c-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-17d81859-33de-49f9-b226-c517db7f481c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-17d81859-33de-49f9-b226-c517db7f481c" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-17d81859-33de-49f9-b226-c517db7f481c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Deleting offline snapshot 17d81859-33de-49f9-b226-c517db7f481c of volume 05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] snapshot_file for this snap is: volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ba797-d5bc-4e13-9216-983860fff040]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:01 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685867368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf668bcd664e42cebd1641ea111a25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:00Z,use_quota=True,user_id='ad2071ec71054aaa98e1fcf8ba0503b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Creating volume 4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:01 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9dae35-b754-4851-807c-a2c600e58e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b722f5d-9671-49ce-a792-4ada30a40b1d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:01 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 1073741824 Jul 17 14:35:01 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17df77d-4f33-48c4-9502-27c839e60a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:01 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Volume volume-7b722f5d-9671-49ce-a792-4ada30a40b1d (7b722f5d-9671-49ce-a792-4ada30a40b1d): created successfully Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17df77d-4f33-48c4-9502-27c839e60a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:01 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (79bf0cc5-2475-4593-9509-8fb01a28e19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:01 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c Jul 17 14:35:01 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:01 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-71f97d67-9efe-4cf8-a2dc-116892ffa5a5 tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:02 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c" returned: 0 in 0.450s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05125052-75a2-4008-9fee-611ca7ea52ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf8fdad-342e-4ba3-96ae-72c5b0a805a2]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:02 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 1073741824" returned: 0 in 0.563s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:02 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec Jul 17 14:35:02 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:02 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 Jul 17 14:35:02 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:02 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" returned: 0 in 0.303s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:02 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec" returned: 0 in 0.495s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a62043b-9dd8-4fd0-b906-f16c8f2ab998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:02 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c Jul 17 14:35:02 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bfeb3b-34aa-4c98-aa96-df0e18b35755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:02 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Volume volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 (4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6): created successfully Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bfeb3b-34aa-4c98-aa96-df0e18b35755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:02 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Flow 'volume_create_manager' (87cfe961-4b78-4b53-899a-e64ce91bdecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:02 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a3b64b81-de11-4c16-9cb2-abe67233a919 tempest-ProjectReaderTests-1195531043 None] Created volume successfully. Jul 17 14:35:03 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:03 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c Jul 17 14:35:03 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:03 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec.17d81859-33de-49f9-b226-c517db7f481c" returned: 0 in 0.337s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-17d81859-33de-49f9-b226-c517db7f481c" released by "_delete_snapshot" :: held 1.825s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 47dc939b-af86-499b-b506-9af8e3c625b5 of volume 7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" released by "delete_snapshot" :: held 1.881s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7f573-824b-4441-a897-1d4a8e1ee0ee]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Created reservations ['98f4e13f-41f0-4233-a998-efb8981c39db', '36194642-98a6-4b1f-8717-3db7d813f3e7', '7789d4ea-84cc-4a46-9dba-1a7c5cd56436', '90944391-c931-4b20-afff-e287233c193f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:03 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d Jul 17 14:35:03 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Delete snapshot completed successfully. Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-c8d9abba-86e4-4e9c-8db3-c48b28bea7e2 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-17d81859-33de-49f9-b226-c517db7f481c-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Acquiring lock "cinder-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "cinder-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Acquiring lock "cinder-quobyte-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:03 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "cinder-quobyte-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-05125052-75a2-4008-9fee-611ca7ea52ec-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a7a53c-6633-4130-a085-070562e7837b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-05125052-75a2-4008-9fee-611ca7ea52ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:04 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d" returned: 0 in 0.513s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:04 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 1G Jul 17 14:35:04 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 Jul 17 14:35:04 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96c095-758d-4bbd-9ab1-ed1ca9edf63d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec Jul 17 14:35:04 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" returned: 0 in 0.455s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6 Jul 17 14:35:04 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec" returned: 0 in 0.503s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:04 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 1G" returned: 0 in 0.613s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b722f5d-9671-49ce-a792-4ada30a40b1d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec Jul 17 14:35:04 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b722f5d-9671-49ce-a792-4ada30a40b1d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 Jul 17 14:35:04 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:04 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "cinder-quobyte-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6" released by "delete_volume" :: held 0.822s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Created reservations ['91a163a9-a98a-44cd-981e-6f1a38378afd', 'c0e210d1-69f1-48d5-84de-21b7efc7254a', '22c0b229-4520-4d0f-8ba0-568ae1fbd01d', '96adddd0-46d8-4b97-a19f-99d0a44730af'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:04 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:04 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:05 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-05125052-75a2-4008-9fee-611ca7ea52ec" returned: 0 in 0.349s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-05125052-75a2-4008-9fee-611ca7ea52ec" released by "delete_volume" :: held 0.937s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:05 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b722f5d-9671-49ce-a792-4ada30a40b1d -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5" returned: 0 in 0.383s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 is being set with open permissions: ugo+rw Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:05 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 Jul 17 14:35:05 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Created reservations ['2403b0ec-7034-48ad-91c1-2bab9af8ece8', '51fa66b4-05fb-414a-8f8a-40c04679f678', 'c30031b0-5265-4936-9f52-bef8573c77a3', 'a0f28a04-81f5-47ea-bca3-c77f92aba3a4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:05 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.305s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Deleted volume successfully. Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-7b4600ea-eee2-4652-97db-04f90aeffa44 tempest-ProjectReaderTests-1195531043 None] Lock "cinder-4e015f30-3d0d-4ed4-a7cf-9c4c7f35efc6-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:05 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:05 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:05 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5" returned: 0 in 0.368s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:05 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info Jul 17 14:35:05 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:05 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Deleted volume successfully. Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8e0c5141-2913-4418-ba0b-0746d1ba6574 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-05125052-75a2-4008-9fee-611ca7ea52ec-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:05 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info" returned: 0 in 0.333s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:05 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info is being set with open permissions: ugo+rw Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:05 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info Jul 17 14:35:05 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Flow 'volume_create_manager' (3f4a6d79-80c0-47a6-b254-7d71d64e5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:05 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53c98c5-194b-4fad-a33d-6c5064b75728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53c98c5-194b-4fad-a33d-6c5064b75728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997079298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ff1ad-e048-4590-8874-2284a894e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf668bcd664e42cebd1641ea111a25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:06Z,use_quota=True,user_id='ad2071ec71054aaa98e1fcf8ba0503b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0aaf03-300b-41ca-bc70-32b5479c7c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0aaf03-300b-41ca-bc70-32b5479c7c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f01d6aa-ec93-429e-b8f8-36a917bda88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f01d6aa-ec93-429e-b8f8-36a917bda88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479ff1ad-e048-4590-8874-2284a894e53d', 'volume_name': 'volume-479ff1ad-e048-4590-8874-2284a894e53d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfd21b1-5099-40ad-8011-5017bf0cf0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfd21b1-5099-40ad-8011-5017bf0cf0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2485970d-bc28-44e7-ab1a-d284809d886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:06 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Volume 479ff1ad-e048-4590-8874-2284a894e53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479ff1ad-e048-4590-8874-2284a894e53d', 'volume_size': 1} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:06 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.info" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997079298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ff1ad-e048-4590-8874-2284a894e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf668bcd664e42cebd1641ea111a25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:06Z,use_quota=True,user_id='ad2071ec71054aaa98e1fcf8ba0503b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Creating volume 479ff1ad-e048-4590-8874-2284a894e53d {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:06 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:06 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d 1073741824 Jul 17 14:35:06 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:06 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-55594e3a-0e48-47d0-9f6c-bd4e65d3552c tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-47dc939b-af86-499b-b506-9af8e3c625b5-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-47dc939b-af86-499b-b506-9af8e3c625b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-47dc939b-af86-499b-b506-9af8e3c625b5" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:06 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d 1073741824" returned: 0 in 0.562s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-47dc939b-af86-499b-b506-9af8e3c625b5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 47dc939b-af86-499b-b506-9af8e3c625b5 of volume 7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f502f7-5c84-495a-8387-1b58e8fc0f16]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:06 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d Jul 17 14:35:06 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:06 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:07 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 Jul 17 14:35:07 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (525848df-e7ed-4dda-a8ea-685ef6d399a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c129f2a-3eab-44ea-b24d-4c3c2464976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c129f2a-3eab-44ea-b24d-4c3c2464976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623413051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8374abe0-7cbe-481b-84a6-875caed96f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:07Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd72776-536f-4016-a41b-e3aeefd3319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd72776-536f-4016-a41b-e3aeefd3319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08a472-75c9-4a94-81ab-ae9bb082c2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08a472-75c9-4a94-81ab-ae9bb082c2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8374abe0-7cbe-481b-84a6-875caed96f84', 'volume_name': 'volume-8374abe0-7cbe-481b-84a6-875caed96f84', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b653446-29f5-4e82-9c72-56ef73fca10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b653446-29f5-4e82-9c72-56ef73fca10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3d619c-aac6-427f-93d1-f785ea64202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Volume 8374abe0-7cbe-481b-84a6-875caed96f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8374abe0-7cbe-481b-84a6-875caed96f84', 'volume_size': 1} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:07 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d" returned: 0 in 0.321s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623413051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8374abe0-7cbe-481b-84a6-875caed96f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:07Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Creating volume 8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:07 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2485970d-bc28-44e7-ab1a-d284809d886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479ff1ad-e048-4590-8874-2284a894e53d', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 1073741824 Jul 17 14:35:07 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f84da5-c82a-4a5e-88e9-2e64f65f775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:07 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Volume volume-479ff1ad-e048-4590-8874-2284a894e53d (479ff1ad-e048-4590-8874-2284a894e53d): created successfully Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f84da5-c82a-4a5e-88e9-2e64f65f775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Flow 'volume_create_manager' (3f4a6d79-80c0-47a6-b254-7d71d64e5c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:07 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-71dccfcf-686e-4dc1-9e3f-ceb182d4092a tempest-ProjectReaderTests-1195531043 None] Created volume successfully. Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5" returned: 0 in 0.475s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b722f5d-9671-49ce-a792-4ada30a40b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d2671-ca8f-468b-8a64-884af0fc37f4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:07 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d Jul 17 14:35:07 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:07 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 1073741824" returned: 0 in 0.507s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:07 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d" returned: 0 in 0.444s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:07 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 Jul 17 14:35:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:07 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:07 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 Jul 17 14:35:07 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:08 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84" returned: 0 in 0.294s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3d619c-aac6-427f-93d1-f785ea64202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8374abe0-7cbe-481b-84a6-875caed96f84', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f437b6-680d-4a07-8dcb-9646806c278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Volume volume-8374abe0-7cbe-481b-84a6-875caed96f84 (8374abe0-7cbe-481b-84a6-875caed96f84): created successfully Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f437b6-680d-4a07-8dcb-9646806c278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (525848df-e7ed-4dda-a8ea-685ef6d399a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Acquiring lock "cinder-479ff1ad-e048-4590-8874-2284a894e53d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4131a3b9-187c-4716-81cd-951818689f0d tempest-ProjectReaderTests-1050265301 None] Created volume successfully. Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "cinder-479ff1ad-e048-4590-8874-2284a894e53d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:08 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5" returned: 0 in 0.418s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Acquiring lock "cinder-quobyte-479ff1ad-e048-4590-8874-2284a894e53d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:08 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5 Jul 17 14:35:08 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "cinder-quobyte-479ff1ad-e048-4590-8874-2284a894e53d" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a576b521-33ea-4dd4-bbce-59b65cefa5a4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:08 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d Jul 17 14:35:08 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:08 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d.47dc939b-af86-499b-b506-9af8e3c625b5" returned: 0 in 0.276s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-47dc939b-af86-499b-b506-9af8e3c625b5" released by "_delete_snapshot" :: held 1.783s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" released by "delete_snapshot" :: held 1.832s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Created reservations ['5aa2e538-2bab-40bd-a60a-39ad86f9f8e8', 'eba18b26-35a4-4664-bab2-201d3b088b22', '7fd51673-e150-4757-ae7c-dc2d5d365f81', '4e91342b-5ea6-42b2-9980-58ac060d99f5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:08 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d" returned: 0 in 0.455s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:08 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d Jul 17 14:35:08 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (9eb6cfbf-22a1-467f-9d07-bc0186791e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f3891e-2206-4594-95c1-b60cc70a63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f3891e-2206-4594-95c1-b60cc70a63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842333481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbc5d92-b15f-474a-8838-7b94a1ffd861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:09Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da38b111-b27f-4251-8e6d-61aef447070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da38b111-b27f-4251-8e6d-61aef447070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dee00c-f620-44c2-8331-73fd235bde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dee00c-f620-44c2-8331-73fd235bde0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbc5d92-b15f-474a-8838-7b94a1ffd861', 'volume_name': 'volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5704018-9b1f-4a81-8333-7e860cea4391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5704018-9b1f-4a81-8333-7e860cea4391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5f966a-c5ec-4913-9083-a5c81f2c3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Volume ffbc5d92-b15f-474a-8838-7b94a1ffd861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861', 'volume_size': 1} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842333481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbc5d92-b15f-474a-8838-7b94a1ffd861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:09Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Creating volume ffbc5d92-b15f-474a-8838-7b94a1ffd861 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:08 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-830d4304-ad18-4fb9-8a58-f7e9b076f97d tempest-ProjectMemberTests-1944025082 None] Lock "cinder-47dc939b-af86-499b-b506-9af8e3c625b5-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-7b722f5d-9671-49ce-a792-4ada30a40b1d-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:08 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 1073741824 Jul 17 14:35:08 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:08 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-7b722f5d-9671-49ce-a792-4ada30a40b1d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:09 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-479ff1ad-e048-4590-8874-2284a894e53d" returned: 0 in 0.293s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "cinder-quobyte-479ff1ad-e048-4590-8874-2284a894e53d" released by "delete_volume" :: held 0.801s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133766a-66aa-4f04-a16c-d931ef6b640b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Created reservations ['b07d2450-8b39-4f57-b85f-fb73f9c0440f', '24e28315-ee46-4b0d-8a15-4528cf7b6d57', '439bdbdb-f370-4304-aa52-877586cef6df', 'f43b09e8-4e14-45b9-b3f4-2669b3c1eac6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:09 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d Jul 17 14:35:09 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:09 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:09 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:09 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 1073741824" returned: 0 in 0.591s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d" returned: 0 in 0.463s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:09 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 Jul 17 14:35:09 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:09 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d Jul 17 14:35:09 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Deleted volume successfully. Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8523b75f-5ce8-487f-98cc-ecdd047861ba tempest-ProjectReaderTests-1195531043 None] Lock "cinder-479ff1ad-e048-4590-8874-2284a894e53d-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:09 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861" returned: 0 in 0.294s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.548s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:09 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5f966a-c5ec-4913-9083-a5c81f2c3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c929c4-7d7d-4165-8ee6-2a5d4d5e939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7b722f5d-9671-49ce-a792-4ada30a40b1d" returned: 0 in 0.312s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Creating offline snapshot 45dd6371-cfe4-4653-884d-e8a1861b3b6e of volume 8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7b722f5d-9671-49ce-a792-4ada30a40b1d" released by "delete_volume" :: held 0.854s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:09 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Volume volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 (ffbc5d92-b15f-474a-8838-7b94a1ffd861): created successfully Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c929c4-7d7d-4165-8ee6-2a5d4d5e939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (9eb6cfbf-22a1-467f-9d07-bc0186791e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd16104-6c27-4be2-b6ab-cc8c107166cf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:09 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-90d2ab37-ad18-485b-9925-c8eaeb594be0 tempest-ProjectReaderTests-1839547086 None] Created volume successfully. Jul 17 14:35:09 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Created reservations ['3053b5a2-4e23-4def-a104-5ddd83d69bc0', 'fd13e9cf-b26f-499d-a975-a3263aea4740', '52e87fe0-2ca0-4f9c-89d8-75f741c499b5', '40867269-cddd-4bee-8a07-df838ff12603'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:10 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 Jul 17 14:35:10 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:10 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:10 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:10 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84" returned: 0 in 0.420s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:10 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e 1G Jul 17 14:35:10 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:10 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:10 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ba723b40-c8b1-4a32-bf9c-d7521af31c65 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-7b722f5d-9671-49ce-a792-4ada30a40b1d-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (58dab050-bf40-499d-a97a-83d69b46e982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b307fde-b79b-4ae3-8947-f2345171713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b307fde-b79b-4ae3-8947-f2345171713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2107031258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6bdb42-1977-45dc-8111-22031f88ebbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:11Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb7b4e4-64fb-4317-9974-60a2b1c96105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb7b4e4-64fb-4317-9974-60a2b1c96105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d74c9d8-3b34-4c27-ba7b-4f1589ea506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d74c9d8-3b34-4c27-ba7b-4f1589ea506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6bdb42-1977-45dc-8111-22031f88ebbc', 'volume_name': 'volume-fd6bdb42-1977-45dc-8111-22031f88ebbc', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853d92cf-25a8-407f-8058-bc1206d63ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853d92cf-25a8-407f-8058-bc1206d63ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eeb5d4-879d-4916-afbc-efc8bf205949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:10 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Volume fd6bdb42-1977-45dc-8111-22031f88ebbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6bdb42-1977-45dc-8111-22031f88ebbc', 'volume_size': 1} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:10 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e 1G" returned: 0 in 0.595s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8374abe0-7cbe-481b-84a6-875caed96f84 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:10 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8374abe0-7cbe-481b-84a6-875caed96f84 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e Jul 17 14:35:10 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-ffbc5d92-b15f-474a-8838-7b94a1ffd861-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "cinder-ffbc5d92-b15f-474a-8838-7b94a1ffd861-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-quobyte-ffbc5d92-b15f-474a-8838-7b94a1ffd861" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-ffbc5d92-b15f-474a-8838-7b94a1ffd861" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb948047-003c-4592-b783-1fdea742340e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:11 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8374abe0-7cbe-481b-84a6-875caed96f84 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e" returned: 0 in 0.399s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:11 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e is being set with open permissions: ugo+rw Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:11 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e Jul 17 14:35:11 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 Jul 17 14:35:11 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e" returned: 0 in 0.311s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:11 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861" returned: 0 in 0.384s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:11 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info Jul 17 14:35:11 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861 Jul 17 14:35:11 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:11 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info is being set with open permissions: ugo+rw Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:11 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ffbc5d92-b15f-474a-8838-7b94a1ffd861" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:11 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info Jul 17 14:35:11 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:11 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-ffbc5d92-b15f-474a-8838-7b94a1ffd861" released by "delete_volume" :: held 0.673s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Created reservations ['f0f2af59-e10a-4eb9-82d0-4cfdb2e784fa', 'fb5a345b-1548-46d2-a5d4-f9169ceed360', '1833e758-6b4f-4149-af1c-dfa6923ae6dd', '62866f25-c5ee-4335-8ac4-fff2c59a0d12'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:12 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:12 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:12 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.info" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2107031258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6bdb42-1977-45dc-8111-22031f88ebbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:11Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Creating volume fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:12 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:12 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc 1073741824 Jul 17 14:35:12 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6f3490d8-d4cd-42f0-a2a5-4e8ff12fef2e tempest-ProjectReaderTests-1050265301 None] Create snapshot completed successfully Jul 17 14:35:12 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.270s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Deleted volume successfully. Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d9198298-724c-4653-9e0d-375cab0b53ef tempest-ProjectReaderTests-1839547086 None] Lock "cinder-ffbc5d92-b15f-474a-8838-7b94a1ffd861-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-45dd6371-cfe4-4653-884d-e8a1861b3b6e-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-45dd6371-cfe4-4653-884d-e8a1861b3b6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-45dd6371-cfe4-4653-884d-e8a1861b3b6e" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-45dd6371-cfe4-4653-884d-e8a1861b3b6e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Deleting offline snapshot 45dd6371-cfe4-4653-884d-e8a1861b3b6e of volume 8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] snapshot_file for this snap is: volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[292ada3a-a3e4-4348-bf4f-81e024fc2b0e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:12 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e Jul 17 14:35:12 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:12 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc 1073741824" returned: 0 in 0.643s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:12 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc Jul 17 14:35:12 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (4c83465f-afe9-4e1f-92f1-171423ac5cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:12 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fab655-54fe-4f8b-afcb-98609f6139ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fab655-54fe-4f8b-afcb-98609f6139ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98999147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8913a40-81db-4cbd-bb30-d1d66c81f5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:13Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643f7b2-8f0f-4b14-8de5-b2c802b6ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643f7b2-8f0f-4b14-8de5-b2c802b6ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece088ca-8678-4ad3-9f0e-8e2434074415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece088ca-8678-4ad3-9f0e-8e2434074415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8913a40-81db-4cbd-bb30-d1d66c81f5a6', 'volume_name': 'volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aeed4d-2c4b-412a-8c53-6c0ff7d89a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aeed4d-2c4b-412a-8c53-6c0ff7d89a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cca8f1-e924-40fc-a59f-918abaf4a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Volume f8913a40-81db-4cbd-bb30-d1d66c81f5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6', 'volume_size': 1} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:13 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e" returned: 0 in 0.455s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8374abe0-7cbe-481b-84a6-875caed96f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fdf658-b270-462e-955a-2ae4de619a56]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:13 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc" returned: 0 in 0.278s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98999147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8913a40-81db-4cbd-bb30-d1d66c81f5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:13Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Creating volume f8913a40-81db-4cbd-bb30-d1d66c81f5a6 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:13 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:13 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 Jul 17 14:35:13 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eeb5d4-879d-4916-afbc-efc8bf205949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6bdb42-1977-45dc-8111-22031f88ebbc', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 1073741824 Jul 17 14:35:13 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef00d2a-6ff6-4800-987c-d40036b7a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Volume volume-fd6bdb42-1977-45dc-8111-22031f88ebbc (fd6bdb42-1977-45dc-8111-22031f88ebbc): created successfully Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef00d2a-6ff6-4800-987c-d40036b7a196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (58dab050-bf40-499d-a97a-83d69b46e982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:13 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-7e042659-0dce-4748-9f44-52b0feb7ed8f tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:13 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84" returned: 0 in 0.369s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:13 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e Jul 17 14:35:13 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:13 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 1073741824" returned: 0 in 0.471s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:13 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 Jul 17 14:35:13 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:13 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e" returned: 0 in 0.376s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:13 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e Jul 17 14:35:13 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:13 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cca8f1-e924-40fc-a59f-918abaf4a838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:13 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064c9e87-f6fc-486f-b848-2b653a06d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:13 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Volume volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 (f8913a40-81db-4cbd-bb30-d1d66c81f5a6): created successfully Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064c9e87-f6fc-486f-b848-2b653a06d90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (4c83465f-afe9-4e1f-92f1-171423ac5cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a92ed2c2-9c71-46c4-93bb-0b8c21310cb7 tempest-ProjectReaderTests-1839547086 None] Created volume successfully. Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:14 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84.45dd6371-cfe4-4653-884d-e8a1861b3b6e" returned: 0 in 0.268s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 00cbba21-d96a-4777-b7e6-eb8493f1a304 of volume fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-45dd6371-cfe4-4653-884d-e8a1861b3b6e" released by "_delete_snapshot" :: held 1.564s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" released by "delete_snapshot" :: held 1.586s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3b7199-b819-4f49-a3de-2f249d0d1a75]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Created reservations ['f5a724c4-a049-403e-9956-062d540e1e15', '39925bde-cc28-4df9-a38b-246b4344fe1b', '4dd52b5c-baaa-4ec1-8143-fbebe9b41308', '83085f65-b69b-4f65-bce1-688e25de6d48'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Delete snapshot completed successfully. Jul 17 14:35:14 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc Jul 17 14:35:14 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-edc1a8c2-b254-4725-b716-5ceb6c136407 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-45dd6371-cfe4-4653-884d-e8a1861b3b6e-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:14 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:14 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 1G Jul 17 14:35:14 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-8374abe0-7cbe-481b-84a6-875caed96f84-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-8374abe0-7cbe-481b-84a6-875caed96f84-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[921d0f12-7441-45db-aa5d-a6e994809f1c]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:14 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 1G" returned: 0 in 0.416s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6bdb42-1977-45dc-8111-22031f88ebbc -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:14 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 Jul 17 14:35:14 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:14 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6bdb42-1977-45dc-8111-22031f88ebbc -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 Jul 17 14:35:14 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-f8913a40-81db-4cbd-bb30-d1d66c81f5a6-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "cinder-f8913a40-81db-4cbd-bb30-d1d66c81f5a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-quobyte-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:15 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84" returned: 0 in 0.425s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4127b528-2be4-4586-b274-d9c8c8b79c8f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84 Jul 17 14:35:15 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6bdb42-1977-45dc-8111-22031f88ebbc -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304" returned: 0 in 0.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 is being set with open permissions: ugo+rw Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 Jul 17 14:35:15 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 Jul 17 14:35:15 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-8374abe0-7cbe-481b-84a6-875caed96f84" returned: 0 in 0.262s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-8374abe0-7cbe-481b-84a6-875caed96f84" released by "delete_volume" :: held 0.747s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:15 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info Jul 17 14:35:15 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Created reservations ['cb0ad83e-88fb-418f-9d1b-3c4cdd12e6c0', 'c333515d-fcd4-4a90-9c4c-8e31b8db84dd', '707e1ff5-1702-463f-94fd-ec7a6822d10f', 'bdd75ee7-b06a-4662-bce7-03f9d86e76d3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:15 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6 Jul 17 14:35:15 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:15 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info" returned: 0 in 0.301s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info is being set with open permissions: ugo+rw Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:15 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info Jul 17 14:35:15 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:15 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" returned: 0 in 0.286s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-f8913a40-81db-4cbd-bb30-d1d66c81f5a6" released by "delete_volume" :: held 0.747s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:16 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Created reservations ['a4839914-461a-4c62-a999-d7bb523371b0', '39cec24e-4d49-4b47-942c-a61d1eedb9ea', '2556d8ba-ec49-4a9b-82b0-907e9f18ddd1', 'b2b59b46-88a2-4b88-aaea-5572675cf49a'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.325s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Deleted volume successfully. Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d8df17fb-d950-40c1-afd2-af2035cc4fd9 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-8374abe0-7cbe-481b-84a6-875caed96f84-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:16 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:16 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:16 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.info" returned: 0 in 0.321s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-eb54a529-608d-4fa3-b51d-9c6ed8b1ce36 tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:16 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.310s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Deleted volume successfully. Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (ec14f910-5835-4815-be0f-6e2081752378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8368325a-c8bb-45e0-bec4-da3c17b241a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3d9803c0-8f4a-4f32-852c-047e03ec016f tempest-ProjectReaderTests-1839547086 None] Lock "cinder-f8913a40-81db-4cbd-bb30-d1d66c81f5a6-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8368325a-c8bb-45e0-bec4-da3c17b241a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929959119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15b75cb-e48e-4e00-85d5-4d9417b01e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:16Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0a691-86d6-493f-a8a8-21808a373a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0a691-86d6-493f-a8a8-21808a373a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b6d8b1-2b15-4a6c-85a5-39991e26e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b6d8b1-2b15-4a6c-85a5-39991e26e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15b75cb-e48e-4e00-85d5-4d9417b01e4c', 'volume_name': 'volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea075cbd-fad9-4eb4-80c1-1dbfdb9bb275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea075cbd-fad9-4eb4-80c1-1dbfdb9bb275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735f27e0-814d-479f-86a6-11d98f853380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Volume b15b75cb-e48e-4e00-85d5-4d9417b01e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c', 'volume_size': 1} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929959119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15b75cb-e48e-4e00-85d5-4d9417b01e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:16Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Creating volume b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:16 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c 1073741824 Jul 17 14:35:16 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (cbdd80f6-6277-4b28-a860-983b4596cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f3dd68-3508-4e74-a542-bd85b206931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f3dd68-3508-4e74-a542-bd85b206931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887445400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3304ee-f728-40d8-b8b0-3b1d4e2b9853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:17Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6286a97f-f414-4543-bd7a-311fe8aab548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6286a97f-f414-4543-bd7a-311fe8aab548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b7b773-2828-4ab2-9f6f-2ffa8c5fe5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b7b773-2828-4ab2-9f6f-2ffa8c5fe5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3304ee-f728-40d8-b8b0-3b1d4e2b9853', 'volume_name': 'volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f43bbf-8452-467c-82b7-8afddda4392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f43bbf-8452-467c-82b7-8afddda4392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf453996-7dc0-408e-bd59-8f61db4ec733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Volume ff3304ee-f728-40d8-b8b0-3b1d4e2b9853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853', 'volume_size': 1} Jul 17 14:35:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:17 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c 1073741824" returned: 0 in 0.452s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:17 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c Jul 17 14:35:17 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-00cbba21-d96a-4777-b7e6-eb8493f1a304-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-00cbba21-d96a-4777-b7e6-eb8493f1a304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-00cbba21-d96a-4777-b7e6-eb8493f1a304" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-00cbba21-d96a-4777-b7e6-eb8493f1a304" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 00cbba21-d96a-4777-b7e6-eb8493f1a304 of volume fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a91c3f-c729-4142-aad7-78e61b4bec5b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:17 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" returned: 0 in 0.319s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887445400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3304ee-f728-40d8-b8b0-3b1d4e2b9853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:17Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Creating volume ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:17 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735f27e0-814d-479f-86a6-11d98f853380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469129bb-238e-4cba-b0b0-1e5885dc6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:17 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 1073741824 Jul 17 14:35:17 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Volume volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c (b15b75cb-e48e-4e00-85d5-4d9417b01e4c): created successfully Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469129bb-238e-4cba-b0b0-1e5885dc6a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (ec14f910-5835-4815-be0f-6e2081752378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:17 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 Jul 17 14:35:17 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d4a1d228-4dc5-4acc-a0c5-f91b2f6a6f9f tempest-ProjectReaderTests-1050265301 None] Created volume successfully. Jul 17 14:35:17 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd6bdb42-1977-45dc-8111-22031f88ebbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f1eac6-5c78-4de7-914b-0705fb130514]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:17 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc Jul 17 14:35:17 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:17 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 1073741824" returned: 0 in 0.482s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:17 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 Jul 17 14:35:17 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:18 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:18 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 Jul 17 14:35:18 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:18 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" returned: 0 in 0.272s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf453996-7dc0-408e-bd59-8f61db4ec733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89a1992-e2b3-489e-819e-8fdb5f447942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:18 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Volume volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 (ff3304ee-f728-40d8-b8b0-3b1d4e2b9853): created successfully Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89a1992-e2b3-489e-819e-8fdb5f447942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (cbdd80f6-6277-4b28-a860-983b4596cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:18 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b2c02650-348f-42ed-9aac-246d5f7b4559 tempest-ProjectReaderTests-1839547086 None] Created volume successfully. Jul 17 14:35:18 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304" returned: 0 in 0.396s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:18 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304 Jul 17 14:35:18 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Creating offline snapshot 57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 of volume b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec5b04d-0a89-43c1-ab55-f8cef8553ecd]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:18 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc.00cbba21-d96a-4777-b7e6-eb8493f1a304" returned: 0 in 0.289s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:18 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-00cbba21-d96a-4777-b7e6-eb8493f1a304" released by "_delete_snapshot" :: held 1.561s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:18 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" released by "delete_snapshot" :: held 1.589s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Created reservations ['79b673e4-d090-458b-8503-aa0384588db9', 'f3446617-a8c5-461c-85ff-0e57dbff0836', 'd7a85429-f7d4-4b0b-8a31-e73cf34d520f', 'b0909f07-3bf3-446e-b5bf-f2d161a0b06d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:18 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-quobyte-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0d574518-eb69-4ec6-bcdf-79753e486c96 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-00cbba21-d96a-4777-b7e6-eb8493f1a304-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0f066-e582-4924-afd0-163ee935250b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" returned: 0 in 0.439s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 1G Jul 17 14:35:19 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:19 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 Jul 17 14:35:19 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:19 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" returned: 0 in 0.392s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853 Jul 17 14:35:19 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-fd6bdb42-1977-45dc-8111-22031f88ebbc-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fd6bdb42-1977-45dc-8111-22031f88ebbc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3774b-3a54-416c-b8cb-39ca6ff5db43]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 1G" returned: 0 in 0.527s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 Jul 17 14:35:19 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:19 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853" released by "delete_volume" :: held 0.744s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:19 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc Jul 17 14:35:19 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Created reservations ['e82d6a66-eede-4def-91d8-77110ffa18de', '0dde83b1-b92f-4769-bcc5-14c0bd863e07', '39058147-4456-4905-b5c6-5338ddb39057', 'f644b5fc-7eb2-49eb-b11b-8e4a14f42db4'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:19 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:19 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" returned: 0 in 0.331s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 is being set with open permissions: ugo+rw Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:20 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 Jul 17 14:35:20 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc" returned: 0 in 0.472s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:20 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc Jul 17 14:35:20 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.283s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:20 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Deleted volume successfully. Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5f214326-a645-4e20-8ae1-50bfcddf7bd5 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-ff3304ee-f728-40d8-b8b0-3b1d4e2b9853-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:20 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" returned: 0 in 0.308s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:20 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info Jul 17 14:35:20 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fd6bdb42-1977-45dc-8111-22031f88ebbc" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fd6bdb42-1977-45dc-8111-22031f88ebbc" released by "delete_volume" :: held 0.890s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Created reservations ['f18101e0-b35b-413d-84db-2996c19426d3', 'fbe8c298-547c-4826-9cd0-a1425722443e', '6c4f632a-caf6-46f9-903e-2812ffce923d', '37142737-12e0-4721-bd9f-3131e1c9cd0e'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:20 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info is being set with open permissions: ugo+rw Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:20 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info Jul 17 14:35:20 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:20 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:20 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (dd19a8a8-c1f5-41f5-a78e-9be67fb2dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0310f-ed5d-4111-927c-57c3cae9503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0310f-ed5d-4111-927c-57c3cae9503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941011500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183d4047-db6a-4e10-91ac-9d9e8190177a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:21Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd20e9a-e88c-4924-9f25-1d5b1705b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd20e9a-e88c-4924-9f25-1d5b1705b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95acfab-6d92-4098-80a3-0c235c1a068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95acfab-6d92-4098-80a3-0c235c1a068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183d4047-db6a-4e10-91ac-9d9e8190177a', 'volume_name': 'volume-183d4047-db6a-4e10-91ac-9d9e8190177a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6d9106-8df0-48d3-92ef-8c521e02439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6d9106-8df0-48d3-92ef-8c521e02439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b923c89e-25a3-40fb-bcb1-79640dca314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:20 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Volume 183d4047-db6a-4e10-91ac-9d9e8190177a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183d4047-db6a-4e10-91ac-9d9e8190177a', 'volume_size': 1} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:20 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.info" returned: 0 in 0.259s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.117s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941011500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183d4047-db6a-4e10-91ac-9d9e8190177a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9f27da49b445899a13a2c4dbd1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:21Z,use_quota=True,user_id='3d67fa571e9542b3ab8b16a74c260a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Creating volume 183d4047-db6a-4e10-91ac-9d9e8190177a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:21 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:21 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.260s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:21 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a 1073741824 Jul 17 14:35:21 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-42009d42-78c1-4c63-8a05-3a6c4b2a9d7a tempest-ProjectReaderTests-1050265301 None] Create snapshot completed successfully Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cd0c3415-c4c7-40be-ac46-55cd90b8c0b3 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fd6bdb42-1977-45dc-8111-22031f88ebbc-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:21 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a 1073741824" returned: 0 in 0.436s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:21 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a Jul 17 14:35:21 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:21 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b923c89e-25a3-40fb-bcb1-79640dca314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183d4047-db6a-4e10-91ac-9d9e8190177a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3963633a-eeb6-4b14-a2d4-b08c5b803c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:21 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Volume volume-183d4047-db6a-4e10-91ac-9d9e8190177a (183d4047-db6a-4e10-91ac-9d9e8190177a): created successfully Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3963633a-eeb6-4b14-a2d4-b08c5b803c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Flow 'volume_create_manager' (dd19a8a8-c1f5-41f5-a78e-9be67fb2dce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e1278300-6e76-486b-835a-adc319cddbe0 tempest-ProjectReaderTests-1839547086 None] Created volume successfully. Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Deleting offline snapshot 57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 of volume b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] snapshot_file for this snap is: volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7dfdf-536c-4b1b-b911-491aa80452de]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:22 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 Jul 17 14:35:22 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (a857c715-5df4-4b64-b70e-e54d4657f613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ee58f-fce3-4122-afa9-659233a244e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ee58f-fce3-4122-afa9-659233a244e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197581525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0dfb89-7a2c-4eed-b391-060d705dbfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:22Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4749c-5f0a-452d-a51a-8b4ee1e622d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4749c-5f0a-452d-a51a-8b4ee1e622d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5fb903-58ef-4d62-9e0b-d2f10113628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5fb903-58ef-4d62-9e0b-d2f10113628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0dfb89-7a2c-4eed-b391-060d705dbfb0', 'volume_name': 'volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ea83af-c327-4f4f-bab4-d91b73a34a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ea83af-c327-4f4f-bab4-d91b73a34a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:22 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53573fe-ebed-4068-b74f-9285dba11ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:22 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Volume fc0dfb89-7a2c-4eed-b391-060d705dbfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0', 'volume_size': 1} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197581525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0dfb89-7a2c-4eed-b391-060d705dbfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:22Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Creating volume fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:22 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" returned: 0 in 0.415s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:22 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 1073741824 Jul 17 14:35:22 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b8d70-530c-4ec8-99e5-229c43cdb298]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:22 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c Jul 17 14:35:22 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:22 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" returned: 0 in 0.381s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:22 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 Jul 17 14:35:22 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-183d4047-db6a-4e10-91ac-9d9e8190177a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-183d4047-db6a-4e10-91ac-9d9e8190177a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "cinder-quobyte-183d4047-db6a-4e10-91ac-9d9e8190177a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-183d4047-db6a-4e10-91ac-9d9e8190177a" acquired by "delete_volume" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:22 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356af54-3be5-4b28-8fa1-ec6d0c3db6fc]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 1073741824" returned: 0 in 0.606s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:23 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 Jul 17 14:35:23 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:23 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a Jul 17 14:35:23 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:23 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" returned: 0 in 0.401s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:23 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5 Jul 17 14:35:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:23 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" returned: 0 in 0.260s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53573fe-ebed-4068-b74f-9285dba11ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6949c8a-eb11-4bda-a9ae-e627a6c5a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:23 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Volume volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 (fc0dfb89-7a2c-4eed-b391-060d705dbfb0): created successfully Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6949c8a-eb11-4bda-a9ae-e627a6c5a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (a857c715-5df4-4b64-b70e-e54d4657f613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:23 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f4e034a4-b2c7-4e70-bd1d-db5274594b70 tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:23 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a" returned: 0 in 0.424s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:23 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a Jul 17 14:35:23 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:23 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c.57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5" released by "_delete_snapshot" :: held 1.562s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" released by "delete_snapshot" :: held 1.587s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Created reservations ['bc0b3feb-c9df-461a-889a-102e37569e73', 'b94e321e-945c-4102-abbb-74e82b10b5fd', '8ecbd0a8-c6de-4ce1-9e8d-77dc5c0bd5e8', '4a4cf0e7-d2c3-47e9-9cc9-755f947442a3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:23 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Delete snapshot completed successfully. Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d3e9a268-d23f-4621-bf4f-e9d87f642731 tempest-ProjectReaderTests-1050265301 None] Lock "cinder-57fe6eb4-3c97-4a07-9ad5-2b0160a767f5-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:23 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-183d4047-db6a-4e10-91ac-9d9e8190177a" returned: 0 in 0.266s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-quobyte-183d4047-db6a-4e10-91ac-9d9e8190177a" released by "delete_volume" :: held 0.747s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Created reservations ['4e0f910e-f745-498e-8348-681b576bb23a', '48d2b22c-e9c0-4bdc-820e-3b25c0b45a33', '9d4900b1-5608-47ea-b767-51d2748e9ade', '028881d4-d9a9-4bc1-97c7-49971afbd9df'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:23 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:23 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:23 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:24 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.276s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:24 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Deleted volume successfully. Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-b15b75cb-e48e-4e00-85d5-4d9417b01e4c-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-e67e213f-c846-4abc-81f1-58e3306d75d9 tempest-ProjectReaderTests-1839547086 None] Lock "cinder-183d4047-db6a-4e10-91ac-9d9e8190177a-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "cinder-b15b75cb-e48e-4e00-85d5-4d9417b01e4c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddffbeb-fbf0-4884-b963-4f488baa95c0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:24 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c Jul 17 14:35:24 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 428d0c4e-167b-4744-8f91-197a411cf70c of volume fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8f6d7-acc1-487f-8133-20673814a024]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:24 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" returned: 0 in 0.428s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:24 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c Jul 17 14:35:24 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:24 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 Jul 17 14:35:24 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:24 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:24 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-b15b75cb-e48e-4e00-85d5-4d9417b01e4c" released by "delete_volume" :: held 0.836s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:25 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" returned: 0 in 0.471s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Created reservations ['f6b45097-1739-48f1-91a1-fbef7090bc66', 'f39d02a1-5712-44a5-8ed3-9e1fa5f21de8', 'f7e827a9-928e-4281-a0ff-5e674b21b788', 'dd8340a5-2703-4121-abc1-2764be730b3d'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:25 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c 1G Jul 17 14:35:25 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:25 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:25 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:25 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.332s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:25 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Deleted volume successfully. Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-d0893b3d-7ffb-4459-8fba-11805e2236bf tempest-ProjectReaderTests-1050265301 None] Lock "cinder-b15b75cb-e48e-4e00-85d5-4d9417b01e4c-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:25 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c 1G" returned: 0 in 0.593s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:25 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c Jul 17 14:35:25 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:25 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:25 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (94121f98-cd16-49e9-abda-be91e818ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf17eb4-56dc-4a31-a4ad-b4adb9e7f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf17eb4-56dc-4a31-a4ad-b4adb9e7f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86829463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd9cb6d-abbc-4a7d-88bb-644f52baba3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:26Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89259f-c7c0-48e2-8e6a-ff1625dcc499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89259f-c7c0-48e2-8e6a-ff1625dcc499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09039128-1137-47a8-9eea-7f21ad4e4c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:25 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09039128-1137-47a8-9eea-7f21ad4e4c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd9cb6d-abbc-4a7d-88bb-644f52baba3a', 'volume_name': 'volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052c93ee-f337-4f24-a900-efd1761064e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052c93ee-f337-4f24-a900-efd1761064e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc1f0dc-aaf4-4849-9262-d5c0e405c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:26 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Volume dcd9cb6d-abbc-4a7d-88bb-644f52baba3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a', 'volume_size': 1} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:26 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:26 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c" returned: 0 in 0.409s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:26 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c is being set with open permissions: ugo+rw Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:35:26 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c Jul 17 14:35:26 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:26 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:26 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info Jul 17 14:35:26 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:26 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:26 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info is being set with open permissions: ugo+rw Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:26 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info Jul 17 14:35:26 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:26 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.info" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86829463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd9cb6d-abbc-4a7d-88bb-644f52baba3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22245d1b183d468085516a91f8bf4519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:26Z,use_quota=True,user_id='5a57957d64c045a6b4c476fe45b9c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Creating volume dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:26 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:26 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a 1073741824 Jul 17 14:35:26 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:26 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-bdc5c8bf-0c8d-4c3f-a8d1-6a5c1d2deedb tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:27 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a 1073741824" returned: 0 in 0.413s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:27 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a Jul 17 14:35:27 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:27 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc1f0dc-aaf4-4849-9262-d5c0e405c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8623cccf-866c-45f0-9858-b6174f66a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:27 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Volume volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a (dcd9cb6d-abbc-4a7d-88bb-644f52baba3a): created successfully Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8623cccf-866c-45f0-9858-b6174f66a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Flow 'volume_create_manager' (94121f98-cd16-49e9-abda-be91e818ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:27 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-17ede0d9-100a-420c-b8a0-5152a587b0f7 tempest-ProjectReaderTests-1050265301 None] Created volume successfully. Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-428d0c4e-167b-4744-8f91-197a411cf70c-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-428d0c4e-167b-4744-8f91-197a411cf70c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-428d0c4e-167b-4744-8f91-197a411cf70c" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-428d0c4e-167b-4744-8f91-197a411cf70c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 428d0c4e-167b-4744-8f91-197a411cf70c of volume fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc126fc-92e5-4283-bdb9-08a592010963]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:27 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:27 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c Jul 17 14:35:27 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Creating offline snapshot 3bce5684-f24f-4de7-b347-e0e6bd406cd8 of volume dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72b0744-3dfe-439d-ad72-f1606cd79ecf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:28 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d805f-9fa6-4d1a-8613-a972dfa7c1cf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:28 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a Jul 17 14:35:28 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:28 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 Jul 17 14:35:28 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:28 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" returned: 0 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:28 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 1G Jul 17 14:35:28 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:28 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" returned: 0 in 0.390s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:28 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:28 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c Jul 17 14:35:28 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c" returned: 0 in 0.344s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:29 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 1G" returned: 0 in 0.421s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:29 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c Jul 17 14:35:29 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 Jul 17 14:35:29 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0.428d0c4e-167b-4744-8f91-197a411cf70c" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-428d0c4e-167b-4744-8f91-197a411cf70c" released by "_delete_snapshot" :: held 1.505s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" released by "delete_snapshot" :: held 1.527s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:29 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 is being set with open permissions: ugo+rw Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:29 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 Jul 17 14:35:29 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Created reservations ['ccd9087f-d5b2-4a83-beac-069c5a296558', '68bf3609-21f1-4e02-bd63-73061ab5c728', '100c59ec-5eba-402f-af67-02cb57e9a2ae', 'ef932c7d-2753-4351-9539-2856307ea978'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:29 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-46b8a8de-9577-4879-bb42-1b26cc83650c tempest-ProjectMemberTests-1944025082 None] Lock "cinder-428d0c4e-167b-4744-8f91-197a411cf70c-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:29 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:29 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info Jul 17 14:35:29 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info" returned: 0 in 0.271s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:29 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info is being set with open permissions: ugo+rw Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-fc0dfb89-7a2c-4eed-b391-060d705dbfb0-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:29 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info Jul 17 14:35:29 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fc0dfb89-7a2c-4eed-b391-060d705dbfb0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:29 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a72533-4aac-408a-8db4-f7c8cf9969d6]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:30 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 Jul 17 14:35:30 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:30 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.info" returned: 0 in 0.261s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:30 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f9212557-e6f2-4ada-b519-21b58b78162e tempest-ProjectReaderTests-1050265301 None] Create snapshot completed successfully Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-3bce5684-f24f-4de7-b347-e0e6bd406cd8-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-3bce5684-f24f-4de7-b347-e0e6bd406cd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-3bce5684-f24f-4de7-b347-e0e6bd406cd8" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-3bce5684-f24f-4de7-b347-e0e6bd406cd8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Deleting offline snapshot 3bce5684-f24f-4de7-b347-e0e6bd406cd8 of volume dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] snapshot_file for this snap is: volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:30 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" returned: 0 in 0.407s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[46625a89-41dd-485f-bf64-34232b615033]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:30 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0 Jul 17 14:35:30 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:30 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 Jul 17 14:35:30 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:30 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fc0dfb89-7a2c-4eed-b391-060d705dbfb0" released by "delete_volume" :: held 0.727s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Created reservations ['28f1f35b-986b-4674-a1a0-923ac8c6d327', 'f4ae5f22-e448-4238-ac09-1b3fe0aca265', '5f75e957-2d52-4163-90c9-3df33dc71908', '8e25a7bd-2b01-4d18-bd62-1f2db063d43f'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:30 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8" returned: 0 in 0.385s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b3ac6-1378-496a-b601-56f73e3b8ab7]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:30 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:30 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:30 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:30 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a Jul 17 14:35:30 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:31 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:31 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-00a2e8eb-235b-456c-af08-35c9fa53074f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fc0dfb89-7a2c-4eed-b391-060d705dbfb0-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:31 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:31 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 Jul 17 14:35:31 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (561dfad0-ee70-4da2-b2a5-578ff99104fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e00fe-b263-432e-93f7-44bebafeb614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e00fe-b263-432e-93f7-44bebafeb614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-710845715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081e4a7b-7c99-4371-979f-b5a60200e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:32Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1811149-9258-47c7-b39f-b957b560efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1811149-9258-47c7-b39f-b957b560efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:31 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2f24e5-8d96-4e81-bc18-db58472f8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2f24e5-8d96-4e81-bc18-db58472f8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081e4a7b-7c99-4371-979f-b5a60200e3bd', 'volume_name': 'volume-081e4a7b-7c99-4371-979f-b5a60200e3bd', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51189b35-bf27-47ad-8676-8c7a46af8282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51189b35-bf27-47ad-8676-8c7a46af8282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97063abd-e731-446c-b1f7-12e7820ad280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:31 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Volume 081e4a7b-7c99-4371-979f-b5a60200e3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081e4a7b-7c99-4371-979f-b5a60200e3bd', 'volume_size': 1} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-710845715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081e4a7b-7c99-4371-979f-b5a60200e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:32Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Creating volume 081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:31 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8" returned: 0 in 0.423s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:31 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd 1073741824 Jul 17 14:35:31 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:31 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8 Jul 17 14:35:31 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:31 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a.3bce5684-f24f-4de7-b347-e0e6bd406cd8" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-3bce5684-f24f-4de7-b347-e0e6bd406cd8" released by "_delete_snapshot" :: held 1.549s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:31 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" released by "delete_snapshot" :: held 1.579s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Created reservations ['0efdbbef-39b4-4a78-8cd1-45f44a2445aa', '7d11a683-f45c-4b7b-a7ef-3dd3fe681358', '17c40259-7ea3-4bec-a19a-2d83fd93ebbd', '900aab30-ecc5-4a08-8e7b-58b9fa3a07b2'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Delete snapshot completed successfully. Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-8ebea7dd-51f6-4c01-8f64-3c71fb6fb6ff tempest-ProjectReaderTests-1050265301 None] Lock "cinder-3bce5684-f24f-4de7-b347-e0e6bd406cd8-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:32 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd 1073741824" returned: 0 in 0.450s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:32 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd Jul 17 14:35:32 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:32 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd" returned: 0 in 0.239s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97063abd-e731-446c-b1f7-12e7820ad280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081e4a7b-7c99-4371-979f-b5a60200e3bd', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a9af79-59cc-4cd3-8639-e4c798557aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:32 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Volume volume-081e4a7b-7c99-4371-979f-b5a60200e3bd (081e4a7b-7c99-4371-979f-b5a60200e3bd): created successfully Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a9af79-59cc-4cd3-8639-e4c798557aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (561dfad0-ee70-4da2-b2a5-578ff99104fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:32 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-69f2d42d-50a6-4147-b28b-f237494aa41d tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "cinder-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Acquiring lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" acquired by "delete_volume" :: waited 0.022s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee7b054-4d4f-4458-a795-759364e7d02d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 57ff1320-9cb3-4c2d-a851-aad4047adc4c of volume 081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:32 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177d3de-408e-4ccd-912c-d56b7f6414e0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:32 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:32 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:32 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd Jul 17 14:35:32 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:33 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" returned: 0 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:33 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a Jul 17 14:35:33 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:33 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd" returned: 0 in 0.367s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:33 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c 1G Jul 17 14:35:33 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:33 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "cinder-quobyte-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a" released by "delete_volume" :: held 0.689s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Created reservations ['44bbaf35-9b1d-481e-9f4f-83bd0d05c926', '96794416-4f47-43bd-b15f-b57303a299a5', 'ba81cd72-bab2-4d9e-8f54-6c9be7abf7a2', '62bef015-9aed-446f-be00-e562ce6e37fc'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:33 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:33 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:33 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c 1G" returned: 0 in 0.477s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081e4a7b-7c99-4371-979f-b5a60200e3bd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:33 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081e4a7b-7c99-4371-979f-b5a60200e3bd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c Jul 17 14:35:33 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:33 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.280s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:33 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Deleted volume successfully. Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-56d27a1e-80e8-422a-9caa-d0600821ef3e tempest-ProjectReaderTests-1050265301 None] Lock "cinder-dcd9cb6d-abbc-4a7d-88bb-644f52baba3a-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:33 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081e4a7b-7c99-4371-979f-b5a60200e3bd -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c" returned: 0 in 0.315s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:33 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c is being set with open permissions: ugo+rw Jul 17 14:35:33 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:33 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c Jul 17 14:35:33 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:34 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:34 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info Jul 17 14:35:34 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:34 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info" returned: 0 in 0.263s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:34 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info is being set with open permissions: ugo+rw Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:34 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info Jul 17 14:35:34 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:34 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.info" returned: 0 in 0.248s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:34 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:34 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-2d0ff729-36c5-4245-98e9-99fecb326a38 tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-57ff1320-9cb3-4c2d-a851-aad4047adc4c-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-57ff1320-9cb3-4c2d-a851-aad4047adc4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:35 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-57ff1320-9cb3-4c2d-a851-aad4047adc4c" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-57ff1320-9cb3-4c2d-a851-aad4047adc4c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 57ff1320-9cb3-4c2d-a851-aad4047adc4c of volume 081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ecdfb-5945-43d2-ad19-39cac66ba9fa]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:36 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c Jul 17 14:35:36 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:36 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c" returned: 0 in 0.381s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-081e4a7b-7c99-4371-979f-b5a60200e3bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d5cd5-6785-4fde-89fb-a0ab1a814141]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:36 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd Jul 17 14:35:36 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:36 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd" returned: 0 in 0.391s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:36 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:36 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c Jul 17 14:35:36 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:37 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:37 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c Jul 17 14:35:37 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:37 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd.57ff1320-9cb3-4c2d-a851-aad4047adc4c" returned: 0 in 0.252s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-57ff1320-9cb3-4c2d-a851-aad4047adc4c" released by "_delete_snapshot" :: held 1.487s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" released by "delete_snapshot" :: held 1.512s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Created reservations ['763e0d35-3604-4390-8ece-777a2d5c46a8', 'e77fccf6-a740-4ee6-af2a-b787af96c280', 'd08faca5-46e3-4283-a2df-b4dc35b060ec', '15f5e54b-b558-4d22-b9f2-cd6d40360fe1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:37 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:37 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-cfe81783-d7dd-40d6-a772-31fa8f508f22 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-57ff1320-9cb3-4c2d-a851-aad4047adc4c-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-081e4a7b-7c99-4371-979f-b5a60200e3bd-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-081e4a7b-7c99-4371-979f-b5a60200e3bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d8e1e5-6279-43c0-8a2f-d32edf5e6c7b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:38 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd Jul 17 14:35:38 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:38 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd" returned: 0 in 0.404s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:38 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd Jul 17 14:35:38 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:38 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-081e4a7b-7c99-4371-979f-b5a60200e3bd" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-081e4a7b-7c99-4371-979f-b5a60200e3bd" released by "delete_volume" :: held 0.722s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:38 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Created reservations ['7bc48d1c-28ca-41d6-b3b2-81d41ffd7049', '8250d44a-741c-4d02-8b90-63e31e913f86', '92c27a44-69ff-4e3f-97a7-431e31360829', '90b22722-553b-4da5-b8f4-4b6f5586209b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:39 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:39 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:39 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:39 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4ffc30a8-c1f3-4cad-b988-99878b27f9f2 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-081e4a7b-7c99-4371-979f-b5a60200e3bd-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (14b69fa4-f549-47ba-a6a9-c066eeb55b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8122f9-f6d6-4c34-882c-295d95c34d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8122f9-f6d6-4c34-882c-295d95c34d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393790385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e25999b-b655-41f3-9ead-42fe5aa5ab9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:40Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7905406f-f8a9-4cbf-b1c2-95300e106084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7905406f-f8a9-4cbf-b1c2-95300e106084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ab3562-bac8-4b68-bf48-c40ef3fb0da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ab3562-bac8-4b68-bf48-c40ef3fb0da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e25999b-b655-41f3-9ead-42fe5aa5ab9e', 'volume_name': 'volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821642c7-e3f6-4e1d-9327-2a5b8e9e401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821642c7-e3f6-4e1d-9327-2a5b8e9e401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8645ccfd-2602-4a5f-9791-1f126cc0e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:39 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Volume 6e25999b-b655-41f3-9ead-42fe5aa5ab9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e', 'volume_size': 1} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393790385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e25999b-b655-41f3-9ead-42fe5aa5ab9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:40Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Creating volume 6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:39 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:39 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:39 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e 1073741824 Jul 17 14:35:39 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:40 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e 1073741824" returned: 0 in 0.448s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:40 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e Jul 17 14:35:40 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:40 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8645ccfd-2602-4a5f-9791-1f126cc0e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a9f408-9d06-4973-a7d4-8734bd22b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:40 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Volume volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e (6e25999b-b655-41f3-9ead-42fe5aa5ab9e): created successfully Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a9f408-9d06-4973-a7d4-8734bd22b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:40 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (14b69fa4-f549-47ba-a6a9-c066eeb55b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:40 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-595b257e-44fc-4a3e-b6ae-f5ae9339b43b tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 378b022e-9768-49c2-bc80-6d937500d6ec of volume 6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b8e66-50bc-4aa9-8b4c-5ec11fd8fdaf]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:42 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e Jul 17 14:35:42 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:42 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:42 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec 1G Jul 17 14:35:42 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:42 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec 1G" returned: 0 in 0.487s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:42 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:43 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec Jul 17 14:35:43 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:43 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec" returned: 0 in 0.350s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:43 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec is being set with open permissions: ugo+rw Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:43 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec Jul 17 14:35:43 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:43 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:43 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info Jul 17 14:35:43 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:43 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info" returned: 0 in 0.284s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:43 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info is being set with open permissions: ugo+rw Jul 17 14:35:43 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:43 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info Jul 17 14:35:43 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:44 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.info" returned: 0 in 0.261s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:44 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:44 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-62c91625-5560-42b3-b9b4-70fac0c7a39d tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-378b022e-9768-49c2-bc80-6d937500d6ec-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-378b022e-9768-49c2-bc80-6d937500d6ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-378b022e-9768-49c2-bc80-6d937500d6ec" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-378b022e-9768-49c2-bc80-6d937500d6ec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 378b022e-9768-49c2-bc80-6d937500d6ec of volume 6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b07dd1f-bc65-4322-94d0-b03e8dcdd07f]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:45 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec Jul 17 14:35:45 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:45 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec" returned: 0 in 0.392s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e381012a-3d3b-4435-b42f-d8f1adb35153]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:45 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e Jul 17 14:35:45 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:46 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" returned: 0 in 0.367s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:46 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec Jul 17 14:35:46 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:46 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec" returned: 0 in 0.348s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:46 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec Jul 17 14:35:46 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:46 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e.378b022e-9768-49c2-bc80-6d937500d6ec" returned: 0 in 0.248s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-378b022e-9768-49c2-bc80-6d937500d6ec" released by "_delete_snapshot" :: held 1.467s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" released by "delete_snapshot" :: held 1.500s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Created reservations ['6127549e-3bff-4dbe-a619-0a779b07312b', 'c665f2e5-a509-4ac4-8afd-d5d6503e2167', '229b4ec5-d891-4aa2-a9f4-617a415cd69d', '5821da0c-1b6a-4a1a-9be6-0df2cd5947e1'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:46 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-ff544c89-b72b-48d7-a041-017f6c52a82a tempest-ProjectMemberTests-1944025082 None] Lock "cinder-378b022e-9768-49c2-bc80-6d937500d6ec-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-6e25999b-b655-41f3-9ead-42fe5aa5ab9e-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-6e25999b-b655-41f3-9ead-42fe5aa5ab9e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef612f-e56d-4d17-beb1-76322b759f94]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:47 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e Jul 17 14:35:47 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:48 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" returned: 0 in 0.402s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:48 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e Jul 17 14:35:48 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:48 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" returned: 0 in 0.255s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-6e25999b-b655-41f3-9ead-42fe5aa5ab9e" released by "delete_volume" :: held 0.732s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Created reservations ['aa48505a-e95c-4f66-82c8-2eba9a1591ac', 'c62e040d-8bae-4399-9f97-19c9ff299276', '851b145b-bd44-4ebd-b4cb-aa7bd93f7b19', 'b30bea27-13f3-4544-98f7-328e1ca61715'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:48 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:48 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:48 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:48 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-deeaf8ea-cf34-4446-b22d-fb9a7790f4b0 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-6e25999b-b655-41f3-9ead-42fe5aa5ab9e-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (01513543-d111-4977-91e3-2a30e5a4c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079330f9-9362-49fa-a108-8fc691fff301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079330f9-9362-49fa-a108-8fc691fff301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369415364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6581b-4c97-4853-8520-b449583e5b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:49Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4b429-ea6a-45dc-be62-33820d2df47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4b429-ea6a-45dc-be62-33820d2df47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1028c68-8027-42df-8d52-fdc17340ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1028c68-8027-42df-8d52-fdc17340ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e6581b-4c97-4853-8520-b449583e5b6f', 'volume_name': 'volume-10e6581b-4c97-4853-8520-b449583e5b6f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24aecc65-50db-4952-a88b-733d8d471246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24aecc65-50db-4952-a88b-733d8d471246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c628bb6a-1d16-4775-bbf0-333481a551b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Volume 10e6581b-4c97-4853-8520-b449583e5b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e6581b-4c97-4853-8520-b449583e5b6f', 'volume_size': 1} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369415364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6581b-4c97-4853-8520-b449583e5b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:49Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Creating volume 10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:49 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:49 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f 1073741824 Jul 17 14:35:49 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:49 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f 1073741824" returned: 0 in 0.490s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:49 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f Jul 17 14:35:49 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:50 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c628bb6a-1d16-4775-bbf0-333481a551b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e6581b-4c97-4853-8520-b449583e5b6f', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcc18ac-6676-4b4b-9aef-67ae44304fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:50 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Volume volume-10e6581b-4c97-4853-8520-b449583e5b6f (10e6581b-4c97-4853-8520-b449583e5b6f): created successfully Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcc18ac-6676-4b4b-9aef-67ae44304fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:50 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (01513543-d111-4977-91e3-2a30e5a4c94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:50 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-32c037b1-ff5a-4368-a1f6-abe52e2f2b5e tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:35:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:51 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 136d9655-9246-4abc-8ff2-93bac816d291 of volume 10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:35:51 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[be13b47c-d142-4683-85c5-b8a60f741645]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:51 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:51 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f Jul 17 14:35:51 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:52 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f" returned: 0 in 0.399s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:52 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 1G Jul 17 14:35:52 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:52 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 1G" returned: 0 in 0.438s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e6581b-4c97-4853-8520-b449583e5b6f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:52 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e6581b-4c97-4853-8520-b449583e5b6f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 Jul 17 14:35:52 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:52 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e6581b-4c97-4853-8520-b449583e5b6f -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291" returned: 0 in 0.376s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:52 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 is being set with open permissions: ugo+rw Jul 17 14:35:52 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:52 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 Jul 17 14:35:52 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:53 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291" returned: 0 in 0.279s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=181,cinder:UPDATE=247,cinder:DELETE=19,cinder:INSERT=67 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:53 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info Jul 17 14:35:53 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:53 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info" returned: 0 in 0.313s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:53 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info is being set with open permissions: ugo+rw Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:53 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info Jul 17 14:35:53 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:53 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.info" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:53 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:INSERT=63,cinder:UPDATE=248,cinder:SELECT=186,cinder:DELETE=23 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:35:53 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-091c6bc3-732b-4bc8-8738-534714742bcd tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-136d9655-9246-4abc-8ff2-93bac816d291-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-136d9655-9246-4abc-8ff2-93bac816d291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-136d9655-9246-4abc-8ff2-93bac816d291" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-136d9655-9246-4abc-8ff2-93bac816d291" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 136d9655-9246-4abc-8ff2-93bac816d291 of volume 10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[19536ec2-b459-4ca4-8895-11de2f052e72]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:55 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 Jul 17 14:35:55 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:55 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291" returned: 0 in 0.443s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e6581b-4c97-4853-8520-b449583e5b6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3fab9e-e1cf-4804-b084-71b0b31c5095]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:55 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f Jul 17 14:35:55 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:55 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f" returned: 0 in 0.473s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:55 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:55 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 Jul 17 14:35:55 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:56 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291" returned: 0 in 0.364s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:56 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291 Jul 17 14:35:56 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:56 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f.136d9655-9246-4abc-8ff2-93bac816d291" returned: 0 in 0.249s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-136d9655-9246-4abc-8ff2-93bac816d291" released by "_delete_snapshot" :: held 1.648s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" released by "delete_snapshot" :: held 1.684s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Created reservations ['7764d38d-9dfc-4f4f-889c-d65c71d0de1d', '51796233-5c5a-483c-8ba9-275dddacdf90', '1c6ee527-7a2a-4ea7-a2a8-046da9bb2d7a', 'a8792572-f536-4083-9a6a-adaea66887f3'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:56 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:35:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-93a657fa-df79-4570-b287-6e14d656821f tempest-ProjectMemberTests-1944025082 None] Lock "cinder-136d9655-9246-4abc-8ff2-93bac816d291-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-10e6581b-4c97-4853-8520-b449583e5b6f-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-10e6581b-4c97-4853-8520-b449583e5b6f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" acquired by "delete_volume" :: waited 0.014s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8a438-9e78-425f-bef2-cfef6155503d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:57 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f Jul 17 14:35:57 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:57 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:57 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f Jul 17 14:35:57 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:57 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-10e6581b-4c97-4853-8520-b449583e5b6f" returned: 0 in 0.246s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-10e6581b-4c97-4853-8520-b449583e5b6f" released by "delete_volume" :: held 0.701s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Created reservations ['b26edc7f-d5d2-4d61-bdf9-fecc3e27e27b', 'b4fc7f9a-1eaa-4a34-a83b-bba2f8f191be', '2612b03c-7ebc-4116-b11b-e91e7778074d', '187c9bfa-e3ef-4c89-9af9-65e2dbdd3b57'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:57 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:35:57 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:58 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:35:58 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-0cacf100-8383-4492-b851-aef3591d5b84 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-10e6581b-4c97-4853-8520-b449583e5b6f-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (6b5fa77f-ee94-4356-b775-587f81578af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa2ede5-bb1e-4fca-9cbf-e235beb3b52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa2ede5-bb1e-4fca-9cbf-e235beb3b52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478676741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea30ccf-4431-42e7-a9dd-39cc053b7c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:59Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ea3d6-2031-4776-b1e0-14a7477e0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ea3d6-2031-4776-b1e0-14a7477e0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78808d1-37d6-4dcd-9e88-fe73f634403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78808d1-37d6-4dcd-9e88-fe73f634403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea30ccf-4431-42e7-a9dd-39cc053b7c26', 'volume_name': 'volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5da62-3465-4040-b1c0-65b37fc08a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5da62-3465-4040-b1c0-65b37fc08a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdefe24-7c7a-4846-b930-d87548ff81b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:58 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Volume fea30ccf-4431-42e7-a9dd-39cc053b7c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26', 'volume_size': 1} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478676741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea30ccf-4431-42e7-a9dd-39cc053b7c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:35:59Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Creating volume fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:35:58 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:35:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:58 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 1073741824 Jul 17 14:35:58 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:59 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 1073741824" returned: 0 in 0.494s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:35:59 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 Jul 17 14:35:59 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:35:59 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26" returned: 0 in 0.296s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdefe24-7c7a-4846-b930-d87548ff81b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49cb5db-2f28-4f77-aa6a-334d90817d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:35:59 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Volume volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 (fea30ccf-4431-42e7-a9dd-39cc053b7c26): created successfully Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49cb5db-2f28-4f77-aa6a-334d90817d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:35:59 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (6b5fa77f-ee94-4356-b775-587f81578af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:35:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-338c4e4d-c1a4-4eb0-981e-516465fef293 tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot c831ba1c-6dfe-4b5f-921d-0e99a56a514d of volume fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[59866db9-3a48-4076-ae24-921fe49dd737]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:01 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 Jul 17 14:36:01 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:01 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26" returned: 0 in 0.408s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:01 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d 1G Jul 17 14:36:01 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:01 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d 1G" returned: 0 in 0.492s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:01 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:02 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d Jul 17 14:36:02 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:02 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d" returned: 0 in 0.368s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:02 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d is being set with open permissions: ugo+rw Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:02 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d Jul 17 14:36:02 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:02 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d" returned: 0 in 0.265s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:02 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info Jul 17 14:36:02 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:02 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:02 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info is being set with open permissions: ugo+rw Jul 17 14:36:02 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:02 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info Jul 17 14:36:02 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:03 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.info" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:03 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:03 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-f89decb6-b5de-48b3-8394-605068e2da34 tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-c831ba1c-6dfe-4b5f-921d-0e99a56a514d-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-c831ba1c-6dfe-4b5f-921d-0e99a56a514d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-c831ba1c-6dfe-4b5f-921d-0e99a56a514d" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-c831ba1c-6dfe-4b5f-921d-0e99a56a514d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot c831ba1c-6dfe-4b5f-921d-0e99a56a514d of volume fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa82d3-7c90-4da5-92ed-7efbcc198a2d]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:04 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d Jul 17 14:36:04 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:04 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d" returned: 0 in 0.361s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc33ef8-1d50-44fa-a555-b5528d28eec0]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:04 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 Jul 17 14:36:04 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:04 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:04 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26" returned: 0 in 0.342s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:05 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d Jul 17 14:36:05 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:05 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d" returned: 0 in 0.326s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:05 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d Jul 17 14:36:05 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:05 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26.c831ba1c-6dfe-4b5f-921d-0e99a56a514d" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-c831ba1c-6dfe-4b5f-921d-0e99a56a514d" released by "_delete_snapshot" :: held 1.357s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" released by "delete_snapshot" :: held 1.380s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Created reservations ['7f902fb1-bf64-4896-a708-087440193d9d', '4627d420-15d1-43a1-9109-562580d3991d', '930c72a1-41b4-4c0a-b9d8-ce641e44cd4a', 'f1c2f064-4aba-4610-ac99-c278c0953ae5'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:05 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:36:05 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-6bf2e3ab-11ff-42a5-af67-0b89a0dc1cd8 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-c831ba1c-6dfe-4b5f-921d-0e99a56a514d-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-fea30ccf-4431-42e7-a9dd-39cc053b7c26-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fea30ccf-4431-42e7-a9dd-39cc053b7c26-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" acquired by "delete_volume" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[84946d57-1eb3-4993-a4f6-9fa47bc5adae]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:06 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 Jul 17 14:36:06 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:06 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26" returned: 0 in 0.377s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:06 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:06 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26 Jul 17 14:36:06 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:07 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-fea30ccf-4431-42e7-a9dd-39cc053b7c26" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-fea30ccf-4431-42e7-a9dd-39cc053b7c26" released by "delete_volume" :: held 0.679s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Created reservations ['c384d793-47a4-4ae9-809d-ee5150b5770e', '0acb8cb1-3c6a-4d1e-b990-d62b898f791b', 'd8832d28-6d40-429f-b61d-a51043365f19', 'ca4a0acf-dfba-4e70-af86-ac273d3e0a69'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:07 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:36:07 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:07 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.258s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:36:07 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-32d2eaea-0676-4631-83b9-18bcc4319ef6 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-fea30ccf-4431-42e7-a9dd-39cc053b7c26-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:07 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (9ae7017a-d4a0-4c20-a0a8-83d59952e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aa0b7e-17e2-4915-8176-1954955e7e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aa0b7e-17e2-4915-8176-1954955e7e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364293249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffca26d-8d07-43ee-9860-a015fed54d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:08Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6576ff9-a44c-4419-9e6e-0fb4e0a8a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6576ff9-a44c-4419-9e6e-0fb4e0a8a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e60eb3-9d9f-48a9-888e-54521ff23035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e60eb3-9d9f-48a9-888e-54521ff23035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffca26d-8d07-43ee-9860-a015fed54d35', 'volume_name': 'volume-7ffca26d-8d07-43ee-9860-a015fed54d35', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc73070-7fb8-40ae-9aa2-d11ba208fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc73070-7fb8-40ae-9aa2-d11ba208fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a85c09-0ae9-40ea-97ba-9f5114d6376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Volume 7ffca26d-8d07-43ee-9860-a015fed54d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffca26d-8d07-43ee-9860-a015fed54d35', 'volume_size': 1} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364293249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffca26d-8d07-43ee-9860-a015fed54d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:08Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Creating volume 7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:36:08 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:08 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 1073741824 Jul 17 14:36:08 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:08 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 1073741824" returned: 0 in 0.437s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:08 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 Jul 17 14:36:08 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:08 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35" returned: 0 in 0.320s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a85c09-0ae9-40ea-97ba-9f5114d6376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffca26d-8d07-43ee-9860-a015fed54d35', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de09c597-efff-4c80-8202-2dbe4ad6487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:08 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Volume volume-7ffca26d-8d07-43ee-9860-a015fed54d35 (7ffca26d-8d07-43ee-9860-a015fed54d35): created successfully Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de09c597-efff-4c80-8202-2dbe4ad6487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:08 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (9ae7017a-d4a0-4c20-a0a8-83d59952e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:08 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-08cb7dad-a9f6-4154-a11f-928416555c3f tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot 40a79cd3-aec6-4836-aea2-8c58485b3c46 of volume 7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f66f0e8-89f9-45b4-9982-38f5c10b1974]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:10 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 Jul 17 14:36:10 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:10 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35" returned: 0 in 0.395s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:10 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:10 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 1G Jul 17 14:36:10 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:11 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 1G" returned: 0 in 0.428s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffca26d-8d07-43ee-9860-a015fed54d35 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:11 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffca26d-8d07-43ee-9860-a015fed54d35 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 Jul 17 14:36:11 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:11 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffca26d-8d07-43ee-9860-a015fed54d35 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46" returned: 0 in 0.324s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:11 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 is being set with open permissions: ugo+rw Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:11 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 Jul 17 14:36:11 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:11 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:11 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info Jul 17 14:36:11 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:11 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:11 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info is being set with open permissions: ugo+rw Jul 17 14:36:11 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:12 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info Jul 17 14:36:12 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:12 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.info" returned: 0 in 0.242s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:12 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a00d05e0-47b9-4859-88b0-038565a7482d tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-40a79cd3-aec6-4836-aea2-8c58485b3c46-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-40a79cd3-aec6-4836-aea2-8c58485b3c46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-40a79cd3-aec6-4836-aea2-8c58485b3c46" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-40a79cd3-aec6-4836-aea2-8c58485b3c46" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot 40a79cd3-aec6-4836-aea2-8c58485b3c46 of volume 7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16a5c15-b791-4734-b7ec-2c1cb277fa19]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:12 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 Jul 17 14:36:12 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:12 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46" returned: 0 in 0.356s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ffca26d-8d07-43ee-9860-a015fed54d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b68fa9-d766-4b04-acc2-b41e532e5a67]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:12 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:12 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 Jul 17 14:36:12 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:13 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35" returned: 0 in 0.365s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:13 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 Jul 17 14:36:13 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:13 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46" returned: 0 in 0.347s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:13 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46 Jul 17 14:36:13 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:13 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35.40a79cd3-aec6-4836-aea2-8c58485b3c46" returned: 0 in 0.251s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-40a79cd3-aec6-4836-aea2-8c58485b3c46" released by "_delete_snapshot" :: held 1.413s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" released by "delete_snapshot" :: held 1.436s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:13 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Created reservations ['8310d114-5183-4dae-86bf-b85a17beac75', '76e3c853-f783-49b5-921e-9c14972a2a5e', '394cd4b6-b22d-4b01-8fa1-19d6b043340f', 'd57dc0fd-d5e6-4484-ac13-d57a75ec2dd6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:14 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-5beca650-6e31-4759-8cb1-b292a48e7855 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-40a79cd3-aec6-4836-aea2-8c58485b3c46-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-7ffca26d-8d07-43ee-9860-a015fed54d35-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-7ffca26d-8d07-43ee-9860-a015fed54d35-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5114730-b467-4f79-9174-b09e0b079024]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:14 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:14 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 Jul 17 14:36:14 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:15 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35" returned: 0 in 0.355s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:15 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35 Jul 17 14:36:15 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:15 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-7ffca26d-8d07-43ee-9860-a015fed54d35" returned: 0 in 0.241s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-7ffca26d-8d07-43ee-9860-a015fed54d35" released by "delete_volume" :: held 0.657s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Created reservations ['0608b5e4-c7c7-4524-8689-1f428300142a', 'ba6040ee-ddfa-429e-9747-89c929b092b3', 'de23ce79-becf-4f2a-808e-9d87888bb114', '741cdd48-223d-4f0d-93b0-4f4a7009c5e8'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:15 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:36:15 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:15 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.236s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:36:15 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:36:15 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3ca0e515-db6f-4eae-9b79-80def891e422 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-7ffca26d-8d07-43ee-9860-a015fed54d35-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (ab751b94-ce8a-4ec0-aa18-9153b8ecc05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012e455b-1446-48e5-85ea-94e18869f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012e455b-1446-48e5-85ea-94e18869f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221659760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f1f644-db54-435b-bd51-bc5a3e776d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:16Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbb2ac2-d110-4589-abec-c34be216c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbb2ac2-d110-4589-abec-c34be216c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21415698-053d-470f-b544-5be59040792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21415698-053d-470f-b544-5be59040792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f1f644-db54-435b-bd51-bc5a3e776d5e', 'volume_name': 'volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef78bc55-17d4-4c2e-8533-d6016cab6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef78bc55-17d4-4c2e-8533-d6016cab6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b963dc-87e9-4560-81d0-de075caac199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:16 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Volume d6f1f644-db54-435b-bd51-bc5a3e776d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e', 'volume_size': 1} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221659760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f1f644-db54-435b-bd51-bc5a3e776d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bade1b79dc5443e9baef9588761abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:16Z,use_quota=True,user_id='1bae3bb53adb449c8a49a62ed72a72d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Creating volume d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:36:16 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:16 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e 1073741824 Jul 17 14:36:16 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:16 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e 1073741824" returned: 0 in 0.406s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:16 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e Jul 17 14:36:16 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:16 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e" returned: 0 in 0.236s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b963dc-87e9-4560-81d0-de075caac199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:16 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331e1d7f-2fcd-4232-917e-f817c6278b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:17 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Volume volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e (d6f1f644-db54-435b-bd51-bc5a3e776d5e): created successfully Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331e1d7f-2fcd-4232-917e-f817c6278b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Flow 'volume_create_manager' (ab751b94-ce8a-4ec0-aa18-9153b8ecc05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:17 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-8cecb164-8260-488b-ae22-f7ee68b334e6 tempest-ProjectMemberTests-1944025082 None] Created volume successfully. Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Creating offline snapshot ad46dea8-eee5-4762-bca4-0f1154cfb74a of volume d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4112120e-db89-4414-854f-9f7fec11f357]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:17 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e Jul 17 14:36:17 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:17 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e" returned: 0 in 0.352s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:17 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:17 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a 1G Jul 17 14:36:17 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:18 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a 1G" returned: 0 in 0.394s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:18 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a Jul 17 14:36:18 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:18 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a" returned: 0 in 0.288s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:18 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a is being set with open permissions: ugo+rw Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:18 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a Jul 17 14:36:18 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:18 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:18 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info Jul 17 14:36:18 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:18 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info" returned: 0 in 0.256s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:18 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info is being set with open permissions: ugo+rw Jul 17 14:36:18 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:18 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info Jul 17 14:36:18 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:19 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.info" returned: 0 in 0.235s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:19 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-5fb7d261-e566-4b24-9bef-5f4b9aff14be tempest-ProjectMemberTests-1944025082 None] Create snapshot completed successfully Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-ad46dea8-eee5-4762-bca4-0f1154cfb74a-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-ad46dea8-eee5-4762-bca4-0f1154cfb74a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-ad46dea8-eee5-4762-bca4-0f1154cfb74a" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-ad46dea8-eee5-4762-bca4-0f1154cfb74a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Deleting offline snapshot ad46dea8-eee5-4762-bca4-0f1154cfb74a of volume d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] snapshot_file for this snap is: volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b5a32-eb2b-45e8-a80f-da3a1aca67c4]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:19 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:19 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a Jul 17 14:36:19 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:20 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a" returned: 0 in 0.373s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[334e5db4-3504-490d-8be2-78356bcce599]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:20 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e Jul 17 14:36:20 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:20 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:20 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a Jul 17 14:36:20 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:20 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a" returned: 0 in 0.362s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:20 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:20 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a Jul 17 14:36:20 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:21 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e.ad46dea8-eee5-4762-bca4-0f1154cfb74a" returned: 0 in 0.243s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-ad46dea8-eee5-4762-bca4-0f1154cfb74a" released by "_delete_snapshot" :: held 1.428s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" released by "delete_snapshot" :: held 1.451s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Created reservations ['79bb060a-4794-4543-a3cb-d2ff9346c376', 'd22a6411-366f-435f-8319-ec5c11530dda', '68f21bc7-1142-4dfb-930d-f8f1c2fb1c66', 'eedba009-03da-4e3d-9de0-c29194ab0380'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:21 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Delete snapshot completed successfully. Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-b98e322b-92f6-4df4-bced-0b4c9a683af5 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-ad46dea8-eee5-4762-bca4-0f1154cfb74a-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-d6f1f644-db54-435b-bd51-bc5a3e776d5e-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-d6f1f644-db54-435b-bd51-bc5a3e776d5e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" acquired by "delete_volume" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[041aaef5-9c9c-406e-b037-abe846563525]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:21 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:21 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e Jul 17 14:36:21 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:22 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e" returned: 0 in 0.374s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:22 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e Jul 17 14:36:22 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:22 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-d6f1f644-db54-435b-bd51-bc5a3e776d5e" returned: 0 in 0.253s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-quobyte-d6f1f644-db54-435b-bd51-bc5a3e776d5e" released by "delete_volume" :: held 0.690s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Created reservations ['29c6d0c2-d6f3-47db-a8b3-d1c95be773f6', 'bb294cc0-df7f-4a1f-8da2-f8848e12ca0d', '68f5539a-9329-448d-9b8d-f8265ff11f46', 'e36b9483-bba8-4351-a218-dbf12c543b79'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:22 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:36:22 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:22 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.247s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:36:22 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Deleted volume successfully. Jul 17 14:36:22 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-228bcd94-5c1d-49da-b9d8-950c34cfd377 tempest-ProjectMemberTests-1944025082 None] Lock "cinder-d6f1f644-db54-435b-bd51-bc5a3e776d5e-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:25 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:36:25 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:26 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.269s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:36:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:36:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:36:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 14:36:32 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=70,cinder:DELETE=8,cinder:SELECT=51,cinder:INSERT=19 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:36:32 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=66,cinder:DELETE=3 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Flow 'volume_create_manager' (9c788b5f-8a5f-412e-badc-9f96a657835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c5551d-4132-4d9b-aebf-5f345b503cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c5551d-4132-4d9b-aebf-5f345b503cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1365274428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304b0214-b9f7-40fb-95b3-9cad980873c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc5645b6b4fcf8c0422c53ea0d52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:45Z,use_quota=True,user_id='0a909575d1744c5a8c760ed380621784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd13bc6c-c9a3-42c8-a52d-794c58d42980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd13bc6c-c9a3-42c8-a52d-794c58d42980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4282a46c-ca11-4333-a763-6eea6546c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4282a46c-ca11-4333-a763-6eea6546c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304b0214-b9f7-40fb-95b3-9cad980873c1', 'volume_name': 'volume-304b0214-b9f7-40fb-95b3-9cad980873c1', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d75541-6e35-4fa6-adf0-4ffd564690cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d75541-6e35-4fa6-adf0-4ffd564690cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d35d0f-957c-47a1-a1fa-a296be21613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:45 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Volume 304b0214-b9f7-40fb-95b3-9cad980873c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304b0214-b9f7-40fb-95b3-9cad980873c1', 'volume_size': 1} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1365274428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304b0214-b9f7-40fb-95b3-9cad980873c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc5645b6b4fcf8c0422c53ea0d52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:45Z,use_quota=True,user_id='0a909575d1744c5a8c760ed380621784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)}" {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Creating volume 304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:36:45 devstack cinder-volume[87804]: INFO cinder.volume.drivers.remotefs [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] casted to osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 Jul 17 14:36:45 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 1073741824 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:45 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 1073741824 Jul 17 14:36:45 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:46 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 1073741824" returned: 0 in 0.459s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:46 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:46 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:46 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'} {{(pid=87804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d35d0f-957c-47a1-a1fa-a296be21613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304b0214-b9f7-40fb-95b3-9cad980873c1', 'volume_size': 1}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f1f0b3-a4bf-43a0-81b7-e71d2ea7b003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:46 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Volume volume-304b0214-b9f7-40fb-95b3-9cad980873c1 (304b0214-b9f7-40fb-95b3-9cad980873c1): created successfully Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f1f0b3-a4bf-43a0-81b7-e71d2ea7b003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Flow 'volume_create_manager' (9c788b5f-8a5f-412e-badc-9f96a657835a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:46 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-877713a5-42fb-46e4-aee1-e61fe316b3d5 tempest-SnapshotDependencyTests-1468573889 None] Created volume successfully. Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Creating offline snapshot 977e4439-2d19-4030-b7f7-6faf6c746cb7 of volume 304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c235bf9-81f0-40ff-a9be-d5a8933a8303]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:46 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:46 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:46 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:47 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.354s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 1G {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:47 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 1G Jul 17 14:36:47 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:47 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 1G" returned: 0 in 0.386s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304b0214-b9f7-40fb-95b3-9cad980873c1 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:47 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304b0214-b9f7-40fb-95b3-9cad980873c1 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:47 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:47 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304b0214-b9f7-40fb-95b3-9cad980873c1 -F qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.295s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:47 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 is being set with open permissions: ugo+rw Jul 17 14:36:47 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:47 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:47 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:48 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.270s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:48 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info Jul 17 14:36:48 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:48 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info" returned: 0 in 0.264s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:48 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info is being set with open permissions: ugo+rw Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:48 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info Jul 17 14:36:48 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:48 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.info" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:48 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:48 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-6c33a52f-ef66-4032-ba1a-93d4ce4713c5 tempest-SnapshotDependencyTests-1468573889 None] Create snapshot completed successfully Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Flow 'volume_create_manager' (82e09f59-8bf5-4863-a3bb-f5801a366181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4f81ac-2dfb-4fc2-bc02-e6436ac9aa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4f81ac-2dfb-4fc2-bc02-e6436ac9aa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T12:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c90785-9976-4fbe-b036-0a6be9e926a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc5645b6b4fcf8c0422c53ea0d52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T12:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=977e4439-2d19-4030-b7f7-6faf6c746cb7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T12:36:49Z,use_quota=True,user_id='0a909575d1744c5a8c760ed380621784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(111d543c-d70d-40d2-953d-2710d5eddb6e),volume_type_id=111d543c-d70d-40d2-953d-2710d5eddb6e)' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333f16c8-5dcd-4287-a9c7-bc8dcaf5d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333f16c8-5dcd-4287-a9c7-bc8dcaf5d982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6072e50-2781-4ed5-8a44-282a36641570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6072e50-2781-4ed5-8a44-282a36641570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5c90785-9976-4fbe-b036-0a6be9e926a9', 'volume_name': 'volume-a5c90785-9976-4fbe-b036-0a6be9e926a9', 'volume_size': 1, 'snapshot_id': '977e4439-2d19-4030-b7f7-6faf6c746cb7'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8684c043-3454-42f0-bd65-06d1333b3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8684c043-3454-42f0-bd65-06d1333b3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b09e5-c2b8-4368-8d0c-05a9ffb3a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:49 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Volume a5c90785-9976-4fbe-b036-0a6be9e926a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5c90785-9976-4fbe-b036-0a6be9e926a9', 'volume_size': 1, 'snapshot_id': '977e4439-2d19-4030-b7f7-6faf6c746cb7'} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7-a5c90785-9976-4fbe-b036-0a6be9e926a9" by "_create_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7-a5c90785-9976-4fbe-b036-0a6be9e926a9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Creating volume a5c90785-9976-4fbe-b036-0a6be9e926a9 from snapshot 977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Selected osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803 as target Quobyte volume. {{(pid=87804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" by "_copy_volume_from_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] snapshot: 977e4439-2d19-4030-b7f7-6faf6c746cb7, volume: a5c90785-9976-4fbe-b036-0a6be9e926a9, {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a4d7f-63dc-40b9-bcd3-e9b8932ac7b1]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:49 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:49 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:49 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.353s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304b0214-b9f7-40fb-95b3-9cad980873c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Creating direct copy from snapshot {{(pid=87804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d0efa-495e-4f42-9978-c7d9adaa9bf5]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:49 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:50 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:50 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:50 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.341s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:50 devstack cinder-volume[87804]: DEBUG cinder.utils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Path /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 not found in is_blk_device check {{(pid=87804) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 14:36:50 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:50 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 Jul 17 14:36:50 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:54 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9" returned: 0 in 3.749s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7129e8c-ffc6-484e-bd57-fd44b01092fb]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:54 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:54 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:54 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.497s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.image.image_utils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Image conversion details: src /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1, size 1024.00 MB, duration 3.75 sec, destination /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 {{(pid=87804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 14:36:54 devstack cinder-volume[87804]: INFO cinder.image.image_utils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Converted 1024.00 MB image at 273.05 MB/s Jul 17 14:36:54 devstack cinder-volume[87804]: WARNING cinder.volume.drivers.remotefs [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 is being set with open permissions: ugo+rw Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:54 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 Jul 17 14:36:54 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:54 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9" returned: 0 in 0.232s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" released by "_copy_volume_from_snapshot" :: held 5.255s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7-a5c90785-9976-4fbe-b036-0a6be9e926a9" released by "_create_volume_from_snapshot" :: held 5.288s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.302s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b09e5-c2b8-4368-8d0c-05a9ffb3a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c90785-9976-4fbe-b036-0a6be9e926a9', 'volume_size': 1, 'snapshot_id': '977e4439-2d19-4030-b7f7-6faf6c746cb7'}' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721024e5-9e8d-44b3-a3c3-d9ac9da341a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 14:36:54 devstack cinder-volume[87804]: INFO cinder.volume.flows.manager.create_volume [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Volume volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 (a5c90785-9976-4fbe-b036-0a6be9e926a9): created successfully Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721024e5-9e8d-44b3-a3c3-d9ac9da341a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87804) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 14:36:54 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Flow 'volume_create_manager' (82e09f59-8bf5-4863-a3bb-f5801a366181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87804) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 14:36:54 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-3e053c40-6fb1-4a08-9196-64fb966708d0 tempest-SnapshotDependencyTests-1468573889 None] Created volume successfully. Jul 17 14:36:55 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-977e4439-2d19-4030-b7f7-6faf6c746cb7-delete_snapshot" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-977e4439-2d19-4030-b7f7-6faf6c746cb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" by "delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7" by "_delete_snapshot" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Deleting offline snapshot 977e4439-2d19-4030-b7f7-6faf6c746cb7 of volume 304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] snapshot_file for this snap is: volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdc1e2-1cb6-4d32-90b6-ae82426f5e7b]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:56 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:56 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:56 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.351s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.remotefs [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304b0214-b9f7-40fb-95b3-9cad980873c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd9833-8979-4406-b8b3-a5a4eaf5166e]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:56 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:56 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:56 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.336s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:56 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:56 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:56 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:57 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.314s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:57 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7 Jul 17 14:36:57 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:57 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1.977e4439-2d19-4030-b7f7-6faf6c746cb7" returned: 0 in 0.224s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-977e4439-2d19-4030-b7f7-6faf6c746cb7" released by "_delete_snapshot" :: held 1.320s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" released by "delete_snapshot" :: held 1.342s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Created reservations ['1669409c-eab7-4769-8322-3f28617bae51', 'eab12b1e-05b8-40f9-867b-a3285fb31c01', '50df6f54-3506-4227-83e0-da7e79c6784e', '8786cbe9-03a0-4fc7-bd58-a9a240dcc6b6'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:57 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Delete snapshot completed successfully. Jul 17 14:36:57 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-4786d7b9-2c0f-4f47-9e3e-e0c1c71df7f2 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-977e4439-2d19-4030-b7f7-6faf6c746cb7-delete_snapshot" released by "delete_snapshot" :: held 1.466s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-304b0214-b9f7-40fb-95b3-9cad980873c1-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-304b0214-b9f7-40fb-95b3-9cad980873c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" acquired by "delete_volume" :: waited 0.013s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a70c1d-ddd1-42f9-9cc8-8398a5ab1b27]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:58 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:58 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:58 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.346s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:58 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1 Jul 17 14:36:58 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:58 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-304b0214-b9f7-40fb-95b3-9cad980873c1" returned: 0 in 0.244s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-304b0214-b9f7-40fb-95b3-9cad980873c1" released by "delete_volume" :: held 0.647s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Created reservations ['21e50f5a-9691-4373-8efc-d1d771258c79', 'cf37fa19-3dd0-4f57-b050-07a6dbbe199c', '07147684-fde8-4aac-9194-6752c77b9caa', '58d4f188-cc3d-4a1e-9324-f2e917aa2211'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:36:58 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:58 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:36:58 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:59 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.230s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:36:59 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Deleted volume successfully. Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-a8e71698-d444-4179-9c92-6ab2196fca70 tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-304b0214-b9f7-40fb-95b3-9cad980873c1-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-a5c90785-9976-4fbe-b036-0a6be9e926a9-delete_volume" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-a5c90785-9976-4fbe-b036-0a6be9e926a9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" by "delete_volume" {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" acquired by "delete_volume" :: waited 0.023s {{(pid=87804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9bd76-ad67-46dc-9797-d9c239d6467a]: (4, 'qcow2') {{(pid=88922) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:59 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 Jul 17 14:36:59 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:36:59 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9" returned: 0 in 0.357s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:36:59 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:36:59 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9 Jul 17 14:36:59 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:37:00 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7/volume-a5c90785-9976-4fbe-b036-0a6be9e926a9" returned: 0 in 0.245s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-quobyte-a5c90785-9976-4fbe-b036-0a6be9e926a9" released by "delete_volume" :: held 0.637s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.quota [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Created reservations ['5df70d6c-8582-4715-93b5-0a40ac086c03', '22aa4f08-77c4-4a5b-a0a3-1fe93d38b02e', '3fb66c43-930b-4c3c-a3ac-fa7c0310c146', 'b6f6887a-48a8-4c4b-b24d-52f75f7e672b'] {{(pid=87804) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:37:00 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:37:00 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:37:00 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.251s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:37:00 devstack cinder-volume[87804]: INFO cinder.volume.manager [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Deleted volume successfully. Jul 17 14:37:00 devstack cinder-volume[87804]: DEBUG cinder.coordination [None req-04673f49-9a8e-42cf-a56d-416d36f104eb tempest-SnapshotDependencyTests-1468573889 None] Lock "cinder-a5c90785-9976-4fbe-b036-0a6be9e926a9-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87804) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 14:37:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=28,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:37:10 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:UPDATE=30,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:37:20 devstack cinder-volume[87804]: DEBUG dbcounter [-] [87804] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803': None} {{(pid=87804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG cinder.volume.drivers.quobyte [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-102da3e8-8726-4338-9a68-fcde5cd52803'] {{(pid=87804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.lockutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87804) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 14:37:25 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 14:37:25 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7 Jul 17 14:37:25 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 14:37:26 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 17 14:37:26 devstack cinder-volume[87804]: DEBUG oslo_concurrency.processutils [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/56c153b89498d67380485c1db5e97dc7" returned: 0 in 0.226s {{(pid=87804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 14:37:26 devstack cinder-volume[87804]: DEBUG cinder.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Notifying Schedulers of capabilities ... {{(pid=87804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 14:37:26 devstack cinder-volume[87804]: DEBUG oslo_service.periodic_task [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] Running periodic task VolumeManager._thread_info {{(pid=87804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 14:37:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread count: 29 {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 14:37:26 devstack cinder-volume[87804]: DEBUG cinder.volume.manager [None req-a124f141-bcd8-4364-bb84-47dc2a4202dc None None] thread info: [<_MainThread(MainThread, started 137056015315072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}